-- Logs begin at Thu 2021-07-22 21:30:30 UTC, end at Thu 2021-07-22 22:37:29 UTC. -- Jul 22 22:04:17.750156 dv-cinder-801868-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 22 22:04:17.758279 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 22 22:04:17.761879 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 22 22:04:17 2021] *** Jul 22 22:04:17.761879 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 22 22:04:17.761879 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 22 22:04:17.761879 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: nodename: dv-cinder-801868-2-iscsi Jul 22 22:04:17.761879 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: machine: x86_64 Jul 22 22:04:17.761879 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: clock source: unix Jul 22 22:04:17.761879 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: pcre jit disabled Jul 22 22:04:17.761879 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: detected number of CPU cores: 4 Jul 22 22:04:17.761879 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: current working directory: / Jul 22 22:04:17.761879 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: detected binary path: /usr/bin/uwsgi-core Jul 22 22:04:17.761879 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: your processes number limit is 47680 Jul 22 22:04:17.762541 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: your memory page size is 4096 bytes Jul 22 22:04:17.762541 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: detected max file descriptor number: 2048 Jul 22 22:04:17.762541 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: lock engine: pthread robust mutexes Jul 22 22:04:17.762541 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: thunder lock: enabled Jul 22 22:04:17.762541 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 22 22:04:17.762541 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 22 22:04:17.806425 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: Python main interpreter initialized at 0x5580fd1809c0 Jul 22 22:04:17.806425 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: python threads support enabled Jul 22 22:04:17.806425 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: your server socket listen backlog is limited to 100 connections Jul 22 22:04:17.806425 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: your mercy for graceful operations on workers is 90 seconds Jul 22 22:04:17.806846 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: mapped 403077 bytes (393 KB) for 2 cores Jul 22 22:04:17.806846 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: *** Operational MODE: preforking *** Jul 22 22:04:17.807133 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: *** uWSGI is running in multiple interpreter mode *** Jul 22 22:04:17.807133 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: spawned uWSGI master process (pid: 92524) Jul 22 22:04:17.807348 dv-cinder-801868-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 22 22:04:17.812773 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: spawned uWSGI worker 1 (pid: 92525, cores: 1) Jul 22 22:04:17.812773 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: spawned uWSGI worker 2 (pid: 92526, cores: 1) Jul 22 22:04:17.812773 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 22 22:04:19.463982 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 22:04:19.463982 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: from cryptography.utils import int_from_bytes Jul 22 22:04:19.464652 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 22:04:19.464652 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: from cryptography.utils import int_from_bytes Jul 22 22:04:19.478726 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 22:04:19.478726 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: from cryptography.utils import int_from_bytes Jul 22 22:04:19.479277 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 22:04:19.479277 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: from cryptography.utils import int_from_bytes Jul 22 22:04:22.205224 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 22 22:04:22.205755 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 22 22:04:22.205937 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 22 22:04:22.206307 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 22 22:04:22.206560 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 22 22:04:22.206945 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.207269 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.207592 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.207914 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.208240 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.208583 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.208908 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.209224 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.209547 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.209810 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.210120 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.210441 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801868-2-iscsi {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.210759 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.211065 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.211375 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.211778 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.212083 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.212786 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.212786 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.213218 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.213656 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.213963 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.214282 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.214619 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.214932 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.215240 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.215558 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.215864 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.216184 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.216520 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.216628 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 22 22:04:22.217014 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 22 22:04:22.217098 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801868-2-iscsi {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.217223 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.217328 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 22 22:04:22.217538 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.217646 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 22 22:04:22.217850 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.217973 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 22 22:04:22.218237 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.218329 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.218554 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.218645 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.218861 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.218953 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.219178 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.219283 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.219498 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.219590 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.219805 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.219904 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.220124 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.220221 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.220467 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.220618 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.220783 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.220928 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.221081 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.221218 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.221354 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.221490 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.221655 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801868-2-iscsi {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.221776 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.221968 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.222055 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.222277 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.222371 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.222594 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.222690 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.222882 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.222971 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.223131 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.223225 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.223439 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.223543 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.223758 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.223859 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.224073 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.224298 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.224414 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.224700 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.224976 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.224976 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.225273 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.225353 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.225426 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.225646 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.225746 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.225829 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.225917 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.226090 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.226180 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.226395 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.226489 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.226701 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.226796 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.227006 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.227092 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.227861 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.227968 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.228174 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.228511 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.228824 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801868-2-iscsi {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.228923 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.229119 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.229284 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.229445 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.229532 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.229750 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.229838 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.230066 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.230179 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.230465 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.110 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.230548 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.230716 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.110 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.230813 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.231027 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.231124 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.231367 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.231450 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.231682 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.231759 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.231988 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.232065 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.232807 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.232902 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.232971 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.233052 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.233122 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.233188 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.233254 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.233319 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.233505 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.233660 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.233822 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.233917 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.234148 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.234236 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.234450 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.234545 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.234699 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.234792 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.234991 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.235087 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.235290 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.235388 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.235605 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.235699 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.235909 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.236003 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.236213 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.236353 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.236497 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.236584 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.236750 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.236839 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.237071 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.237167 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.237390 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.237485 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.237696 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.237781 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.237999 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.238094 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.238300 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.238389 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.238599 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.238694 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.238901 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.238996 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.239203 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.239290 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.239503 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.239598 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.239810 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.239895 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.240120 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.240205 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.240448 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.240565 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.241157 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.241316 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.241402 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.241481 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.241567 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.241657 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.241745 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.241825 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.110 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.241939 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.242026 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.110 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.242242 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.242342 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.242557 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.242645 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.242909 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.243074 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.243280 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.243599 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.244432 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.244547 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.244739 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.244833 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.245056 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.245160 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.245353 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.245447 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.245658 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.245747 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.245973 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.246068 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.246279 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.246363 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.246582 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.246669 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.246884 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.246971 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.247138 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.247231 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.247447 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.247534 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.247932 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.248039 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.248039 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.248158 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.248367 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.248520 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.248666 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.248756 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.248979 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.249064 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.249284 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.249369 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.249592 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.249678 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.249896 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.249982 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.250199 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.250294 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.250506 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.250591 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.250816 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.250902 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.251124 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.251221 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.251432 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.251519 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.251739 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.251825 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.252047 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.252144 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.252396 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.252501 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.252719 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.252806 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.253030 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.253117 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.253339 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.253432 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.253647 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.253742 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.253955 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.254049 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.254269 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.254355 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.254575 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.254660 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.255149 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.255250 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.255465 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.255558 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.255771 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.255856 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.256078 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.256167 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.256436 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.256538 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.257094 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.257214 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.257214 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.257446 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.257526 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.257605 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.257690 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.257776 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.257934 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.258031 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.258253 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.258350 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.258589 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.258681 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.259008 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.259379 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.259485 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.259650 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.259779 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.259964 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.260093 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.260407 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.260624 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.260713 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.260811 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.260928 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.261017 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.261244 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.261331 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.261565 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.261664 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.261878 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.261967 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.262191 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.262299 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.262530 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.262619 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.262841 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.262928 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.263150 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.263239 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.263453 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.263540 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:04:22.263758 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.263846 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.264069 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.264163 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.264403 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.264496 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.264712 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.264814 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.265032 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.265125 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.265358 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.265453 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.265667 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.265756 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.265999 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.266094 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.266306 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.266405 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.266618 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.266706 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.266930 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.267056 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.267234 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.267331 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.267544 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.267630 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.267855 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.267942 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.268158 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.268261 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.268506 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.268594 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.268817 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.268916 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.269124 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.269284 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.269447 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.269536 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.269750 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.269844 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.270054 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.270142 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.270370 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.270463 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.270680 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.270768 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.270993 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.271079 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.271302 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.271389 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.271626 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.271745 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.271940 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.272042 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.272250 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.272422 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.272609 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.272696 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.272935 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.273024 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.273252 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.273370 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.273578 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.273754 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.273883 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.273978 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.274355 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.274537 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.274741 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.275004 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.275095 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.275331 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.275419 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.275641 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.275735 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.275949 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.276037 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.276261 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.276424 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.276598 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.276687 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.276912 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.277001 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.277218 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.277307 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.277522 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.277617 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.277826 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.277914 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.278146 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.278241 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.278456 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.278556 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.278762 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.278850 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.279068 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.279156 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.279375 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.279474 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.279704 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.279790 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.280010 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.280097 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.280343 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.280516 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.280662 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.280749 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.280978 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.281065 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.281287 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.281388 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.281598 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.281706 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.281907 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.282006 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.282211 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.282306 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.282521 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.282608 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.282827 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.282914 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.283134 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.283221 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.283446 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.283541 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.283758 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.283845 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.284065 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.284199 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.284411 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.284502 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.284746 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.284835 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.285057 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.285145 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.285369 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.285502 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.285692 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.285780 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.286004 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.286092 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.286315 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.286401 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.286627 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.286722 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.286935 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.287034 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.287261 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.287412 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.287551 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.287648 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.287865 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.287951 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.288172 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.288258 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.288506 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.288607 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.288811 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.288949 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.289121 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.289216 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.289427 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.289523 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.290256 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.290357 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.290637 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.290952 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.291048 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.291277 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.291373 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.291591 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.291685 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.291983 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.292103 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.292230 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.292371 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.292561 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.292657 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.292868 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.292965 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.293192 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.293286 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.293503 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.293597 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.293829 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.293988 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.294140 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.294348 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.294443 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.294524 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.294740 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.294840 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.295054 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.295142 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.295360 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.295447 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.295679 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.295775 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.295991 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.296081 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.296319 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.296411 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.296652 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.296803 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.296947 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.297024 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.297257 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.297348 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.297563 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.297650 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.297876 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.297964 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.298184 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.298278 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.298496 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.298592 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.298807 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.298894 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.299118 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.299205 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.299431 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.299525 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.299745 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.299831 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.300053 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.300151 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.300388 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.300477 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.300699 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.300785 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.301005 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.301105 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.301317 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.301404 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.301633 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.301729 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.301949 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.302214 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.302315 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.302545 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.302633 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.302863 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.302948 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.303177 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.303273 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.303485 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.303579 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.303794 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.303891 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.304109 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.304212 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.304458 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.304559 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.304773 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.304868 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.305081 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.305174 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.305453 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.306255 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.306367 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.306546 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.306801 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.307130 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.307456 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.307578 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.307578 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.307794 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.307877 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.307955 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.308034 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.308112 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.308335 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.308444 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.308669 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.308771 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.308947 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.309034 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.309253 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.309348 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.309568 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.309696 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.309870 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.309958 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.310182 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.310271 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.310485 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.310579 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.310806 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.310893 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.311114 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.311204 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.311418 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.311506 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.311723 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.311818 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.312027 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.312115 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.312392 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.312493 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.312696 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.312785 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.313011 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.313106 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.313327 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.313422 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.313642 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.313738 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.313967 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.314056 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.314269 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.314355 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.314582 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.314680 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.314884 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.314971 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.315189 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.315276 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.315493 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.315616 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.315807 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.315910 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.316114 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.316396 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.316501 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.316736 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.316833 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.317051 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.317152 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.317363 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.317451 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.317670 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.317769 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.317975 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.318063 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.318283 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.318377 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.318586 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.318681 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.318897 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.318984 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.319203 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.319290 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.319506 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.319595 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.319806 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.319954 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.320116 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.320205 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.320452 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.320531 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.320754 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.320840 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.321105 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.321214 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.321402 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.321731 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.321825 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.322019 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.322136 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.322373 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.322543 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.322630 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.322748 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.322913 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.323061 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.323220 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.323372 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.323528 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.323692 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.323851 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.324001 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.324161 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.324341 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.324489 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.324654 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.324797 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.324982 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.325086 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.325299 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.325387 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.325609 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.325754 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.325920 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.326022 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.326230 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.326319 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.326576 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.326663 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.326882 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.326977 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.327186 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.327273 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.327491 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.327579 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.327795 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.327883 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.328103 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.328190 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.328429 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.328519 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.328734 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.328823 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.329035 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.329122 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.329337 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.329423 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.329637 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.329726 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.329955 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.330042 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.330264 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.330357 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.330566 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.330654 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.330869 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.330963 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.331173 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.331267 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.331487 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.331586 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.331800 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.331888 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.332108 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.332197 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.332444 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.332548 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.332753 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.332840 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.333073 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.333161 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.333385 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.333484 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.333692 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.333780 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.333997 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.334083 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.334297 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.334384 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.334608 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.334740 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.334912 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.335001 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.335224 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.335320 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.335529 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.335616 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.335837 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.335931 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.336147 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.336255 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.336469 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.336598 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.336873 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.337204 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.337335 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.337524 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.337612 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.337849 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.337937 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.338154 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.338251 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.338464 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.338552 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.338775 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.338862 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.339085 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.339182 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.339396 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.339484 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.339700 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.339786 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.340008 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.340103 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.340342 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.340436 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.340655 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.340743 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.340968 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.341057 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.341272 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.341366 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.341577 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.341663 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.341882 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.341976 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.342192 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.342279 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.342496 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.342591 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.342808 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.342896 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.343114 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.343201 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.343419 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.343516 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.343726 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.343813 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.344029 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.344124 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.344359 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.344461 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.344670 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.344802 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.344981 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.345113 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.345289 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.345425 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.345599 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.345737 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.345905 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.346044 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.346248 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.346349 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.346556 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.346643 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.346915 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.347002 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.347227 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.347423 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.347544 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.347634 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.347865 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.347953 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.348179 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.348268 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.348537 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.348625 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.348860 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.348948 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.349168 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.349257 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.349489 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.349595 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.349795 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.349882 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.350109 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.350204 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.350415 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.350508 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.350721 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.350807 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.351025 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.351112 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.351346 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.351433 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.351649 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.351750 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.351974 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.352076 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.352926 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.353029 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.353438 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.353546 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.353854 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.353943 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.354176 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.354288 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.354502 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.354722 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.354817 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.354915 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.355117 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.355242 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.355434 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.355567 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.355751 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.355894 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.356072 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.356203 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.356414 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.356548 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.356732 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.356862 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.357049 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.357187 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.357362 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.357512 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.357679 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.357829 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.357994 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.358148 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.358304 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.358457 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.358632 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.358783 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.358949 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.359107 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.359263 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.359426 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.359576 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.359751 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.359885 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.360167 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.360256 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.360516 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.360605 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.360830 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.360983 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.361152 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.361302 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.361477 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.361620 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.361786 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.361932 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.362095 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.362247 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.362408 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.362564 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.362717 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.362883 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.363027 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.363205 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.363349 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.363515 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.363663 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.363934 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.364030 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.364251 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.364370 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.364589 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.364677 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.364897 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.365025 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.365205 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.365293 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.365510 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.365596 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.365823 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.365912 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.366148 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.366235 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.366454 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.366541 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.366840 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.366960 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.367062 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.367130 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.367378 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.367467 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.367697 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.367871 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.368044 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.368382 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.368486 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.368693 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.368930 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.369019 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.369256 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.369344 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.369572 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.369669 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.369931 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.370017 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.370261 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.370348 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.370592 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.370688 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.370916 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.371011 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.371241 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.371327 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.371566 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.371660 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.371875 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.371962 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.372190 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.372321 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.372529 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.372618 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.372833 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.372921 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.373137 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.373225 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.373447 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.373535 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.373757 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.373845 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.374063 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.374156 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.374367 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.374455 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.374676 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.374771 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.374982 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.375113 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.375287 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.375375 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.375592 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.375716 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.375915 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.376044 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.376223 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.376385 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.376571 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.376735 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.376964 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.377068 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.377192 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.377328 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.377500 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.377637 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.377838 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.377954 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.378136 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.378266 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.378443 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.378579 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.378779 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.378905 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.379099 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.379222 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.379423 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.379539 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.380007 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.380110 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.380346 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.380453 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.380691 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.380796 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.380998 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.381089 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.381318 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.381418 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.381638 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.381726 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.381961 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.382055 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.382283 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.382412 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.382583 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.382678 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.382902 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.382989 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.383209 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.383311 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.384144 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.384344 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.384644 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.384817 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.384942 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.385131 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.385446 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.385536 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.385760 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.385849 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.386111 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.386201 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.386425 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.386514 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.386742 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.386836 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.387088 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.387193 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.387385 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.387473 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.387699 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.387907 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.388004 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.388085 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.388332 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.388440 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.388650 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.388748 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.388981 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.389069 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.389310 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.389399 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.389615 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.389710 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.389922 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.390011 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.390236 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.390323 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.390566 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.390667 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.390853 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.390941 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.391160 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.391256 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.391474 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.391635 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.391782 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.391879 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.392089 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.392176 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.392424 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.392519 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.392750 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.392839 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.393061 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.393166 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.393379 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.393466 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.393980 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.394085 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.394168 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.394258 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.394341 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.394428 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.394596 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.394685 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.394924 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.395037 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.395238 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.395384 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.395555 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.395651 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.395883 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.395984 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.396209 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.396319 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.396556 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.396643 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.396872 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.396961 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.397231 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.397386 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.397864 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.398052 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.398150 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.398241 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.398331 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.398413 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.398493 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.398648 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.398750 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.398974 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.399198 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.400007 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.400356 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.400463 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.400682 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.400821 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.401012 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.401102 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.401321 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.401417 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.401627 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.401716 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.401941 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.402190 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.402286 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.402527 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.402617 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.402848 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.402937 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.403159 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.403253 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.403468 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.403564 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.403790 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.403878 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.404101 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.404199 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.404438 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.404669 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.404758 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.405025 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.405113 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.405344 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.405480 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.405672 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.405759 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.405997 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.406083 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.406318 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.406407 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.406629 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.406718 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.406956 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.407044 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.407266 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.407356 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.407573 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.407661 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.407891 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.407979 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.408203 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.408335 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.408536 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.408625 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.408841 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.408946 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.409155 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.409244 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.409467 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.409555 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.409771 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.409875 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.410081 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.410170 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.410386 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.410475 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.410712 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.410808 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.411019 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.411114 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.411325 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.411414 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.411630 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.411719 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.411943 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.412038 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.412250 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.412415 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.412580 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.412671 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.413204 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.413313 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.413397 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.413478 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.413569 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.413652 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.413785 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.413875 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.414094 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.414190 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.414405 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.414695 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.414857 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.415047 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.415400 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.415562 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.415757 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.415912 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.416086 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.416251 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.416409 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.416609 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.416751 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.416939 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.417071 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.417268 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.417358 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.417605 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.417740 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.417920 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.418008 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.418231 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.418317 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.418548 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.418792 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.418894 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.419115 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.419205 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.419477 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.419651 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.419801 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.419987 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.420115 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.420371 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.420482 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.420672 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.420762 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.421014 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.421293 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.421383 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.421616 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.421704 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.421923 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.422011 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.422250 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.422339 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.422564 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.422662 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.422877 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.422974 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.423211 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.423319 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.423497 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.423585 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.423807 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.423903 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.424117 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.424213 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.424452 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.424540 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.424765 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.424856 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.425073 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.425173 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.425381 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.425471 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.425698 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.425786 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.426015 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.426115 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.426325 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.426414 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.427151 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.427270 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.427270 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.427455 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.427455 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.427604 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.427691 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.427773 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.427861 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.427943 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.428149 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.428238 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.428490 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.428580 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.428890 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.429002 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.429120 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.429206 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.429404 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.429491 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.429718 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.429815 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.430040 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.430150 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.430861 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.430971 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.431386 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.431685 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.431785 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.432006 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.432098 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.432356 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.432452 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.432656 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.432746 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.432975 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.433063 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.433289 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.433379 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.433827 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.433928 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.434010 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.434114 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.434206 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.434324 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.434521 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.434659 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.434838 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.435066 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.435153 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.435221 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.435468 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.435565 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.435792 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.435962 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.436138 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.436427 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.436586 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.436734 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.436877 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.437085 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.437298 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.437459 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.437639 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.437736 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.437963 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.438062 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.438300 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.438421 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.438612 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.438709 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.438936 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.439101 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.439247 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.439395 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.439544 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.439697 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.439856 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.440005 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.440166 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.440357 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.440550 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.440702 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.440812 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.440896 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.441099 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.441236 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.441409 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.441497 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.441722 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.441813 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.442032 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.442119 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.442341 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.442427 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.442653 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.442742 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.442965 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.443054 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.443283 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.443378 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.443601 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.443688 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.443911 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.443999 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.444228 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.444350 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.444571 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.444659 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.444883 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.444971 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.445196 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.445297 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.445511 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.445606 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.445841 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.446078 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.446889 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.447215 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.447382 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.447580 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.447734 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.447909 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.448080 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.448227 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.448560 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.448714 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.448844 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.448997 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.449173 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.449336 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.449487 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.449639 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.449760 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.449904 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.450005 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.450219 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.450317 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.450539 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.450636 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.450854 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.450943 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.451167 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.451256 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.451488 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.451577 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.451798 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.451887 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.452108 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.452196 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.452446 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.452537 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.452772 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.452861 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.453107 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.453195 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.453430 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.453517 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.453759 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.453854 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.454073 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.454159 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.454394 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.454491 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.454654 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 22 22:04:22.454742 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.455013 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.455328 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.455642 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.455970 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.456327 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.456630 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.456946 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.457272 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.457587 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.457911 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.458220 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.458539 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.458853 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.459171 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.459508 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.459822 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.460152 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.460496 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.460822 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.461135 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.461462 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.462264 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.462666 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.462989 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.463385 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.463721 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.463963 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.464291 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.464609 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.464925 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.465241 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.465576 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.465909 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.466219 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.466548 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.466871 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.467198 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.467521 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.467839 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.468172 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.468517 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.468838 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.469154 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.469579 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.469789 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.470114 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.470442 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.470770 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.471098 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.471424 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.471772 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.472095 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.473227 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.473227 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:04:22.473227 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 22 22:04:22.478678 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG oslo_db.sqlalchemy.engines [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:04:22.496386 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_db.sqlalchemy.engines [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:04:22.558948 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.context [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5f4ff4e-504c-4af6-92c6-2f1d71fba296(cell1) {{(pid=92526) load_cells /opt/stack/nova/nova/context.py:464}} Jul 22 22:04:22.563229 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG oslo_concurrency.lockutils [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:04:22.564858 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG oslo_concurrency.lockutils [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:04:22.565659 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG oslo_concurrency.lockutils [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:04:22.567599 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG oslo_concurrency.lockutils [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:04:22.578041 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.context [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5f4ff4e-504c-4af6-92c6-2f1d71fba296(cell1) {{(pid=92525) load_cells /opt/stack/nova/nova/context.py:464}} Jul 22 22:04:22.578752 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG oslo_db.sqlalchemy.engines [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:04:22.581170 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG oslo_db.sqlalchemy.engines [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:04:22.582361 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:04:22.584002 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:04:22.584879 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:04:22.587675 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:04:22.600209 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_db.sqlalchemy.engines [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:04:22.604147 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_db.sqlalchemy.engines [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:04:22.940770 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG oslo_db.sqlalchemy.engines [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:04:22.970221 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_db.sqlalchemy.engines [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:04:23.291077 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: WARNING keystonemiddleware.auth_token [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 22:04:23.297803 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: WARNING keystonemiddleware.auth_token [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 22:04:23.316874 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: WARNING keystonemiddleware.auth_token [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 22:04:23.324035 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: WARNING keystonemiddleware.auth_token [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 22:04:23.648880 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: WARNING keystonemiddleware.auth_token [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 22:04:23.654838 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: WARNING keystonemiddleware.auth_token [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 22:04:23.660008 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580fd1809c0 pid: 92526 (default app) Jul 22 22:04:23.662191 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:04:23.663730 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] 10.222.0.110 "GET /compute/v2.1/" status: 200 len: 389 microversion: 2.1 time: 0.001843 Jul 22 22:04:23.664152 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 1/1] 10.222.0.110 () {50 vars in 794 bytes} [Thu Jul 22 22:04:23 2021] GET /compute/v2.1/ => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:04:23.672693 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: WARNING keystonemiddleware.auth_token [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 22:04:23.677987 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: WARNING keystonemiddleware.auth_token [None req-11ab1d01-961e-441a-8dd3-340b00718c75 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 22:04:23.683740 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5580fd1809c0 pid: 92525 (default app) Jul 22 22:05:47.582400 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:05:47.583536 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001578 Jul 22 22:05:47.584883 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 2/2] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:05:47 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:05:48.035309 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-2b6dd599-c651-4e98-b7e2-7cc49665dadf admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:05:48.064723 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-2b6dd599-c651-4e98-b7e2-7cc49665dadf admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.472611 Jul 22 22:05:48.065482 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 1/3] 10.222.0.110 () {60 vars in 1297 bytes} [Thu Jul 22 22:05:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:05:50.322595 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:05:50.323593 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-24395b65-5a6e-4941-94f6-3773301ac307 None None] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001419 Jul 22 22:05:50.324009 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 3/4] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:05:50 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:05:50.419741 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-f68137cb-b6f5-43cf-802c-464c1a224924 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "swap": 0, "ram": 256, "vcpus": 1, "disk": 1}} {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:05:50.439014 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:05:50.439014 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: warnings.warn(msg) Jul 22 22:05:50.474443 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-f68137cb-b6f5-43cf-802c-464c1a224924 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.61 time: 0.143800 Jul 22 22:05:50.479031 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 2/5] 10.222.0.110 () {64 vars in 1288 bytes} [Thu Jul 22 22:05:50 2021] POST /compute/v2.1/flavors => generated 409 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:05:50.702754 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-7243c2c6-da6e-4aee-a081-671e3c084ba5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:05:50.705124 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:05:50.705124 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: warnings.warn(msg) Jul 22 22:05:50.757412 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-7243c2c6-da6e-4aee-a081-671e3c084ba5 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.272298 Jul 22 22:05:50.758178 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 4/6] 10.222.0.110 () {64 vars in 1341 bytes} [Thu Jul 22 22:05:50 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:05:53.048087 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-f68137cb-b6f5-43cf-802c-464c1a224924 admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:05:53.049064 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-f68137cb-b6f5-43cf-802c-464c1a224924 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001513 Jul 22 22:05:53.049754 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 3/7] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:05:53 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:05:53.155561 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-d90e3758-436d-49a7-866c-30e25fe6a85f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "swap": 0}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:05:53.174486 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:05:53.174486 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: warnings.warn(msg) Jul 22 22:05:53.193579 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-d90e3758-436d-49a7-866c-30e25fe6a85f admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.136730 Jul 22 22:05:53.194411 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 5/8] 10.222.0.110 () {64 vars in 1288 bytes} [Thu Jul 22 22:05:53 2021] POST /compute/v2.1/flavors => generated 406 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:05:53.207025 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-ee36bb89-93f9-446e-af3f-a190479aa987 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:05:53.209636 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:05:53.209636 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: warnings.warn(msg) Jul 22 22:05:53.242658 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-ee36bb89-93f9-446e-af3f-a190479aa987 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039216 Jul 22 22:05:53.243161 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 4/9] 10.222.0.110 () {64 vars in 1341 bytes} [Thu Jul 22 22:05:53 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:05:55.483127 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-d90e3758-436d-49a7-866c-30e25fe6a85f admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:05:55.485187 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-d90e3758-436d-49a7-866c-30e25fe6a85f admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002791 Jul 22 22:05:55.486062 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 6/10] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:05:55 2021] GET /compute/v2.1 => generated 389 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:05:55.545724 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-ca28350e-b6bb-41fc-a8be-0972625e145a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "ram": 1024}} {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:05:55.564508 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-ca28350e-b6bb-41fc-a8be-0972625e145a admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.072173 Jul 22 22:05:55.565249 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 5/11] 10.222.0.110 () {64 vars in 1288 bytes} [Thu Jul 22 22:05:55 2021] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:05:55.582836 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-6a0e3ef3-48ef-4387-be92-2f2deace1d16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:05:55.628259 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-6a0e3ef3-48ef-4387-be92-2f2deace1d16 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052551 Jul 22 22:05:55.631365 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 7/12] 10.222.0.110 () {64 vars in 1341 bytes} [Thu Jul 22 22:05:55 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:05:58.198538 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-ca28350e-b6bb-41fc-a8be-0972625e145a admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:05:58.200041 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-ca28350e-b6bb-41fc-a8be-0972625e145a admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002038 Jul 22 22:05:58.200870 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 6/13] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:05:58 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:05:58.273300 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-b756d0fd-e25e-4cf2-bf9c-5e7b387027a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "name": "ds2G", "swap": 0, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:05:58.292517 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-b756d0fd-e25e-4cf2-bf9c-5e7b387027a6 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.084802 Jul 22 22:05:58.293080 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 8/14] 10.222.0.110 () {64 vars in 1288 bytes} [Thu Jul 22 22:05:58 2021] POST /compute/v2.1/flavors => generated 406 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:05:58.305466 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-97c0c2a4-808e-46f8-a23d-97d6e08fc7af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:05:58.332903 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-97c0c2a4-808e-46f8-a23d-97d6e08fc7af admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031718 Jul 22 22:05:58.334374 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 7/15] 10.222.0.110 () {64 vars in 1341 bytes} [Thu Jul 22 22:05:58 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:06:00.630442 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-b756d0fd-e25e-4cf2-bf9c-5e7b387027a6 admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:00.631776 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-b756d0fd-e25e-4cf2-bf9c-5e7b387027a6 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001973 Jul 22 22:06:00.632184 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 9/16] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:06:00 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:06:00.689770 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-c2caf605-db76-468d-b52d-caa5fbb75e72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "disk": 20, "os-flavor-access:is_public": true}} {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:00.714685 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-c2caf605-db76-468d-b52d-caa5fbb75e72 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075841 Jul 22 22:06:00.717195 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 8/17] 10.222.0.110 () {64 vars in 1288 bytes} [Thu Jul 22 22:06:00 2021] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:06:00.728173 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-cc060c6e-0097-46d2-943b-4abf0ea76faf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:00.754567 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-cc060c6e-0097-46d2-943b-4abf0ea76faf admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030958 Jul 22 22:06:00.755865 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 10/18] 10.222.0.110 () {64 vars in 1341 bytes} [Thu Jul 22 22:06:00 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:06:03.079035 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-c2caf605-db76-468d-b52d-caa5fbb75e72 admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:03.080047 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-c2caf605-db76-468d-b52d-caa5fbb75e72 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001433 Jul 22 22:06:03.080690 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 9/19] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:06:03 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:06:03.151123 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-e59d135a-e62d-4205-b860-88abe22187af admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:03.177929 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-e59d135a-e62d-4205-b860-88abe22187af admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2116 microversion: 2.61 time: 0.089782 Jul 22 22:06:03.178698 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 11/20] 10.222.0.110 () {60 vars in 1297 bytes} [Thu Jul 22 22:06:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2116 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:06:05.400103 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-c2caf605-db76-468d-b52d-caa5fbb75e72 admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:05.401247 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-c2caf605-db76-468d-b52d-caa5fbb75e72 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001626 Jul 22 22:06:05.401706 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 10/21] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:06:05 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:06:05.463139 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-b36c3f28-314a-4b1b-aeff-7618d0f98a88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "ram": 512, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:05.484360 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-b36c3f28-314a-4b1b-aeff-7618d0f98a88 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076669 Jul 22 22:06:05.484965 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 12/22] 10.222.0.110 () {64 vars in 1288 bytes} [Thu Jul 22 22:06:05 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:06:05.498035 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-020f040a-bbbc-494a-b785-e66fe40b9244 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:05.522652 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-020f040a-bbbc-494a-b785-e66fe40b9244 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028207 Jul 22 22:06:05.523232 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 11/23] 10.222.0.110 () {64 vars in 1338 bytes} [Thu Jul 22 22:06:05 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:06:08.167617 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-b36c3f28-314a-4b1b-aeff-7618d0f98a88 admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:08.168673 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-b36c3f28-314a-4b1b-aeff-7618d0f98a88 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001463 Jul 22 22:06:08.169254 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 13/24] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:06:08 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:06:08.228841 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-2a3851ec-7da0-4f5b-b644-93c00a44eb3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "disk": 20, "id": "2"}} {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:08.247429 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-2a3851ec-7da0-4f5b-b644-93c00a44eb3e admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.072223 Jul 22 22:06:08.247995 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 12/25] 10.222.0.110 () {64 vars in 1288 bytes} [Thu Jul 22 22:06:08 2021] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:06:08.262124 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-5fcf4fe1-71e1-4a59-a043-97d98393e27d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:08.290791 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-5fcf4fe1-71e1-4a59-a043-97d98393e27d admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033632 Jul 22 22:06:08.291720 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 14/26] 10.222.0.110 () {64 vars in 1338 bytes} [Thu Jul 22 22:06:08 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:06:10.533076 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-2a3851ec-7da0-4f5b-b644-93c00a44eb3e admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:10.534088 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-2a3851ec-7da0-4f5b-b644-93c00a44eb3e admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001518 Jul 22 22:06:10.534491 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 13/27] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:06:10 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:06:10.593075 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-f295d475-248c-4cb5-b5bd-a85fdc571417 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "id": "3"}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:10.611205 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-f295d475-248c-4cb5-b5bd-a85fdc571417 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.070724 Jul 22 22:06:10.611756 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 15/28] 10.222.0.110 () {64 vars in 1288 bytes} [Thu Jul 22 22:06:10 2021] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:06:10.623610 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-09b0366e-132a-4740-9c24-325fba968d0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:10.647643 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-09b0366e-132a-4740-9c24-325fba968d0b admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027550 Jul 22 22:06:10.648232 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 14/29] 10.222.0.110 () {64 vars in 1338 bytes} [Thu Jul 22 22:06:10 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:06:12.859774 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-f295d475-248c-4cb5-b5bd-a85fdc571417 admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:12.860846 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-f295d475-248c-4cb5-b5bd-a85fdc571417 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001552 Jul 22 22:06:12.861236 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 16/30] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:06:12 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:06:12.923647 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-fff25465-c869-40af-93f0-46689e7ea7f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "vcpus": 4, "disk": 80, "swap": 0, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:12.941827 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-fff25465-c869-40af-93f0-46689e7ea7f0 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.073867 Jul 22 22:06:12.942608 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 15/31] 10.222.0.110 () {64 vars in 1288 bytes} [Thu Jul 22 22:06:12 2021] POST /compute/v2.1/flavors => generated 407 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:06:12.954025 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-ac46c241-4903-42e8-a400-6a761a91b117 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:12.978671 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-ac46c241-4903-42e8-a400-6a761a91b117 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028250 Jul 22 22:06:12.979166 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 17/32] 10.222.0.110 () {64 vars in 1338 bytes} [Thu Jul 22 22:06:12 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:06:15.255413 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-fff25465-c869-40af-93f0-46689e7ea7f0 admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:15.257114 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-fff25465-c869-40af-93f0-46689e7ea7f0 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002917 Jul 22 22:06:15.257964 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 16/33] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:06:15 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:06:15.319912 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-75c7ded4-5eea-47e0-8044-a2c977aa80e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "swap": 0, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:15.339535 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-75c7ded4-5eea-47e0-8044-a2c977aa80e4 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.61 time: 0.075637 Jul 22 22:06:15.340095 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 18/34] 10.222.0.110 () {64 vars in 1288 bytes} [Thu Jul 22 22:06:15 2021] POST /compute/v2.1/flavors => generated 410 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:06:15.352002 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-4c892af6-4a17-45e2-98f2-646d633c870e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:06:15.377240 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-4c892af6-4a17-45e2-98f2-646d633c870e admin admin] 10.222.0.110 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029159 Jul 22 22:06:15.378091 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 17/35] 10.222.0.110 () {64 vars in 1338 bytes} [Thu Jul 22 22:06:15 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:06:55.441867 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-75c7ded4-5eea-47e0-8044-a2c977aa80e4 admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:55.442798 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-75c7ded4-5eea-47e0-8044-a2c977aa80e4 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001528 Jul 22 22:06:55.443199 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 19/36] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:06:55 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:06:55.501114 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-e1cae671-db1c-4b9a-a645-064af30ff8ce admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:55.518567 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-e1cae671-db1c-4b9a-a645-064af30ff8ce admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4222 microversion: 2.61 time: 0.068848 Jul 22 22:06:55.519116 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 18/37] 10.222.0.110 () {60 vars in 1297 bytes} [Thu Jul 22 22:06:55 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:06:56.962547 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-75c7ded4-5eea-47e0-8044-a2c977aa80e4 admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:56.963558 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-75c7ded4-5eea-47e0-8044-a2c977aa80e4 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001454 Jul 22 22:06:56.963960 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 20/38] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:06:56 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:06:57.164698 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-b15a77dc-9ee1-4825-a95f-c50979748dec admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:57.170529 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.wsgi [None req-b15a77dc-9ee1-4825-a95f-c50979748dec admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 22 22:06:57.171168 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-b15a77dc-9ee1-4825-a95f-c50979748dec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:06:57.171937 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-b15a77dc-9ee1-4825-a95f-c50979748dec admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.062221 Jul 22 22:06:57.172701 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 19/39] 10.222.0.110 () {60 vars in 1196 bytes} [Thu Jul 22 22:06:57 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 22 22:06:57.182492 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-751b8d97-171f-4c25-965f-416567c13600 admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:57.205914 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-751b8d97-171f-4c25-965f-416567c13600 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.026285 Jul 22 22:06:57.206524 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 21/40] 10.222.0.110 () {60 vars in 1216 bytes} [Thu Jul 22 22:06:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:06:57.217072 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-b9d01e6c-de1a-4e69-a5bc-21f984c215a3 admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:57.241409 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-b9d01e6c-de1a-4e69-a5bc-21f984c215a3 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.028036 Jul 22 22:06:57.242026 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 20/41] 10.222.0.110 () {60 vars in 1216 bytes} [Thu Jul 22 22:06:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:06:57.253510 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-861a8a1c-4dd8-44c2-b55f-f595a3f47150 admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:57.259603 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.wsgi [None req-861a8a1c-4dd8-44c2-b55f-f595a3f47150 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 22 22:06:57.260218 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-861a8a1c-4dd8-44c2-b55f-f595a3f47150 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:06:57.261112 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-861a8a1c-4dd8-44c2-b55f-f595a3f47150 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.012774 Jul 22 22:06:57.261686 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 22/42] 10.222.0.110 () {60 vars in 1196 bytes} [Thu Jul 22 22:06:57 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 22 22:06:58.635943 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-b9d01e6c-de1a-4e69-a5bc-21f984c215a3 admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:58.636986 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-b9d01e6c-de1a-4e69-a5bc-21f984c215a3 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001466 Jul 22 22:06:58.637378 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 21/43] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:06:58 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:06:58.830841 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-ee370202-e906-45a3-83bc-b970af0621c4 admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:58.836343 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.wsgi [None req-ee370202-e906-45a3-83bc-b970af0621c4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 22 22:06:58.836923 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-ee370202-e906-45a3-83bc-b970af0621c4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:06:58.837730 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-ee370202-e906-45a3-83bc-b970af0621c4 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.059879 Jul 22 22:06:58.838259 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 23/44] 10.222.0.110 () {60 vars in 1196 bytes} [Thu Jul 22 22:06:58 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 22 22:06:58.847752 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-9b180fb4-d1f9-451c-987a-d8846dba2e2f admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:58.861148 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-9b180fb4-d1f9-451c-987a-d8846dba2e2f admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.017140 Jul 22 22:06:58.861697 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 22/45] 10.222.0.110 () {60 vars in 1216 bytes} [Thu Jul 22 22:06:58 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:06:58.871251 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-8afaf9be-787f-43c9-8976-dee68627e0b9 admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:58.885850 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-8afaf9be-787f-43c9-8976-dee68627e0b9 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.018023 Jul 22 22:06:58.886427 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 24/46] 10.222.0.110 () {60 vars in 1216 bytes} [Thu Jul 22 22:06:58 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:06:58.896761 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-53624312-3872-471a-8d9f-5728477de673 admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:06:58.901991 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.wsgi [None req-53624312-3872-471a-8d9f-5728477de673 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 22 22:06:58.902550 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-53624312-3872-471a-8d9f-5728477de673 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:06:58.903329 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-53624312-3872-471a-8d9f-5728477de673 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010186 Jul 22 22:06:58.903838 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 23/47] 10.222.0.110 () {60 vars in 1196 bytes} [Thu Jul 22 22:06:58 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 22 22:07:00.262996 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-8afaf9be-787f-43c9-8976-dee68627e0b9 admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:00.264005 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-8afaf9be-787f-43c9-8976-dee68627e0b9 admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001453 Jul 22 22:07:00.264445 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 25/48] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:07:00 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:07:00.450723 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-9bad2f59-a760-4bb6-b211-d9bf521946b5 admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:00.455989 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.wsgi [None req-9bad2f59-a760-4bb6-b211-d9bf521946b5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 22 22:07:00.456479 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-9bad2f59-a760-4bb6-b211-d9bf521946b5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:07:00.457262 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-9bad2f59-a760-4bb6-b211-d9bf521946b5 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.055669 Jul 22 22:07:00.457773 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 24/49] 10.222.0.110 () {60 vars in 1199 bytes} [Thu Jul 22 22:07:00 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 22 22:07:00.466976 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-4fab9da6-f3df-460f-acac-cf7346f38b0f admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:00.480691 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-4fab9da6-f3df-460f-acac-cf7346f38b0f admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.017225 Jul 22 22:07:00.481207 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 26/50] 10.222.0.110 () {60 vars in 1216 bytes} [Thu Jul 22 22:07:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:07:00.491675 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:00.505562 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] 10.222.0.110 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2076 microversion: 2.88 time: 0.017693 Jul 22 22:07:00.506107 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 25/51] 10.222.0.110 () {60 vars in 1216 bytes} [Thu Jul 22 22:07:00 2021] GET /compute/v2.1/flavors?is_public=None => generated 2076 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:07:00.515359 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-f7bc0c84-4990-45b5-b46e-c06cde6cc3da admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:00.522525 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.wsgi [None req-f7bc0c84-4990-45b5-b46e-c06cde6cc3da admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 22 22:07:00.523155 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-f7bc0c84-4990-45b5-b46e-c06cde6cc3da admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:07:00.523959 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-f7bc0c84-4990-45b5-b46e-c06cde6cc3da admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.012169 Jul 22 22:07:00.524509 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 27/52] 10.222.0.110 () {60 vars in 1199 bytes} [Thu Jul 22 22:07:00 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 22 22:07:01.881985 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:01.882986 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001426 Jul 22 22:07:01.883517 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 26/53] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:07:01 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:07:02.076647 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-1e2bbf62-98ab-4ab9-b752-ae49e1b0e324 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:07:02.097802 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-1e2bbf62-98ab-4ab9-b752-ae49e1b0e324 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.88 time: 0.069983 Jul 22 22:07:02.098274 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 28/54] 10.222.0.110 () {64 vars in 1241 bytes} [Thu Jul 22 22:07:02 2021] POST /compute/v2.1/flavors => generated 406 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:07:03.480091 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:03.481118 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001446 Jul 22 22:07:03.481512 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 27/55] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:07:03 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:07:03.672062 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-e89b9f2d-6256-4927-a3b0-82a54159dd2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:07:03.690968 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-e89b9f2d-6256-4927-a3b0-82a54159dd2a admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.069521 Jul 22 22:07:03.691428 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 29/56] 10.222.0.110 () {64 vars in 1241 bytes} [Thu Jul 22 22:07:03 2021] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:07:05.065613 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:05.066627 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001438 Jul 22 22:07:05.067031 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 28/57] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:07:05 2021] GET /compute/v2.1 => generated 389 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:07:05.260121 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-e93444fa-4ffd-4553-aaa9-ae1399f5e9c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:07:05.279395 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-e93444fa-4ffd-4553-aaa9-ae1399f5e9c3 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.070842 Jul 22 22:07:05.279884 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 30/58] 10.222.0.110 () {64 vars in 1241 bytes} [Thu Jul 22 22:07:05 2021] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:07:06.640850 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:06.642071 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001891 Jul 22 22:07:06.642468 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 29/59] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:07:06 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:07:06.833489 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-4a04f373-a39d-4698-8009-c99e6c265087 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:07:06.851998 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-4a04f373-a39d-4698-8009-c99e6c265087 admin admin] 10.222.0.110 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.88 time: 0.068557 Jul 22 22:07:06.852498 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 31/60] 10.222.0.110 () {64 vars in 1241 bytes} [Thu Jul 22 22:07:06 2021] POST /compute/v2.1/flavors => generated 411 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:07:08.218935 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:08.220607 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001989 Jul 22 22:07:08.221006 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 30/61] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:07:08 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:07:08.409987 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-30985d09-fb21-4cfe-8bfd-bca1838e043f admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:08.429863 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-30985d09-fb21-4cfe-8bfd-bca1838e043f admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/detail" status: 200 len: 5805 microversion: 2.88 time: 0.069910 Jul 22 22:07:08.430311 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 32/62] 10.222.0.110 () {60 vars in 1208 bytes} [Thu Jul 22 22:07:08 2021] GET /compute/v2.1/flavors/detail => generated 5805 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:07:54.643335 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:54.644392 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-a8dbaf41-e1ac-43c3-b28f-de763a1a472a admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001499 Jul 22 22:07:54.644817 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 31/63] 10.222.0.110 () {54 vars in 936 bytes} [Thu Jul 22 22:07:54 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:07:54.704158 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-6d7287cd-9df1-4de3-b5cc-3514fbc843d6 admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:54.723897 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-6d7287cd-9df1-4de3-b5cc-3514fbc843d6 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5819 microversion: 2.61 time: 0.072086 Jul 22 22:07:54.724454 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 33/64] 10.222.0.110 () {60 vars in 1297 bytes} [Thu Jul 22 22:07:54 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5819 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:07:54.746645 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-72e07b7e-2727-43b2-969b-d50e90087ccc admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:54.754590 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-72e07b7e-2727-43b2-969b-d50e90087ccc admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011910 Jul 22 22:07:54.755125 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 32/65] 10.222.0.110 () {60 vars in 1288 bytes} [Thu Jul 22 22:07:54 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:07:54.767248 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-c7922c38-2c04-4072-b63b-d250dc1e525c admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:54.774915 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-c7922c38-2c04-4072-b63b-d250dc1e525c admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011244 Jul 22 22:07:54.775419 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 34/66] 10.222.0.110 () {60 vars in 1291 bytes} [Thu Jul 22 22:07:54 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:07:54.787231 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-3d28f84a-142a-49f8-845c-7a7e934277a6 admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:54.795237 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-3d28f84a-142a-49f8-845c-7a7e934277a6 admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011510 Jul 22 22:07:54.795753 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 33/67] 10.222.0.110 () {60 vars in 1291 bytes} [Thu Jul 22 22:07:54 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:07:54.806606 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-f6691e91-55a4-4bc5-b76c-bbdcf381146b admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:07:54.814555 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-f6691e91-55a4-4bc5-b76c-bbdcf381146b admin admin] 10.222.0.110 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011442 Jul 22 22:07:54.815069 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 35/68] 10.222.0.110 () {60 vars in 1288 bytes} [Thu Jul 22 22:07:54 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:09:34.938143 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-a3c0aac8-c912-4ecd-a332-59a52de33919 tempest-verify_tempest_config-384857500 tempest-verify_tempest_config-384857500-project] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:09:34.941597 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-a3c0aac8-c912-4ecd-a332-59a52de33919 tempest-verify_tempest_config-384857500 tempest-verify_tempest_config-384857500-project] 10.222.0.110 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.133870 Jul 22 22:09:34.941870 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 34/69] 10.222.0.110 () {58 vars in 1139 bytes} [Thu Jul 22 22:09:34 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:11:16.741827 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-f6691e91-55a4-4bc5-b76c-bbdcf381146b admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:11:16.742872 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-f6691e91-55a4-4bc5-b76c-bbdcf381146b admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001492 Jul 22 22:11:16.743628 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 36/70] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:11:16 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:11:17.144027 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-7a8d6275-9b18-4d91-a8b9-30d537c106ba admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:11:17.145449 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:11:17.145449 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: warnings.warn(msg) Jul 22 22:11:17.147338 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-7a8d6275-9b18-4d91-a8b9-30d537c106ba admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:11:17.147784 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-7a8d6275-9b18-4d91-a8b9-30d537c106ba admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:11:17.148602 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-7a8d6275-9b18-4d91-a8b9-30d537c106ba admin admin] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:11:17.149038 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-7a8d6275-9b18-4d91-a8b9-30d537c106ba admin admin] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:11:17.188999 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-7a8d6275-9b18-4d91-a8b9-30d537c106ba admin admin] 10.222.0.110 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.187492 Jul 22 22:11:17.189657 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 35/71] 10.222.0.110 () {60 vars in 1199 bytes} [Thu Jul 22 22:11:17 2021] GET /compute/v2.1/os-services => generated 791 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:11:18.654941 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-f6691e91-55a4-4bc5-b76c-bbdcf381146b admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:11:18.655965 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-f6691e91-55a4-4bc5-b76c-bbdcf381146b admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.001478 Jul 22 22:11:18.656387 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 37/72] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:11:18 2021] GET /compute/v2.1 => generated 389 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:11:18.902278 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-a469a0d1-52fe-4d49-9926-ddaf0f9fd91c admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:11:18.904541 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:11:18.904541 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: warnings.warn(msg) Jul 22 22:11:18.906404 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-a469a0d1-52fe-4d49-9926-ddaf0f9fd91c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:11:18.906892 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-a469a0d1-52fe-4d49-9926-ddaf0f9fd91c admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:11:18.907747 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-a469a0d1-52fe-4d49-9926-ddaf0f9fd91c admin admin] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:11:18.908237 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-a469a0d1-52fe-4d49-9926-ddaf0f9fd91c admin admin] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:11:18.929106 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-a469a0d1-52fe-4d49-9926-ddaf0f9fd91c admin admin] 10.222.0.110 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.108719 Jul 22 22:11:18.929695 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 36/73] 10.222.0.110 () {60 vars in 1199 bytes} [Thu Jul 22 22:11:18 2021] GET /compute/v2.1/os-services => generated 791 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:11:30.889869 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-f6691e91-55a4-4bc5-b76c-bbdcf381146b admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:11:30.891437 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-f6691e91-55a4-4bc5-b76c-bbdcf381146b admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002274 Jul 22 22:11:30.892106 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 38/74] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:11:30 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:11:31.093714 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-4c6a0df7-5d9b-4a82-9a67-5d7b47977cb1 admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:11:31.094856 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:11:31.094856 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: warnings.warn(msg) Jul 22 22:11:31.096504 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-4c6a0df7-5d9b-4a82-9a67-5d7b47977cb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:11:31.096949 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-4c6a0df7-5d9b-4a82-9a67-5d7b47977cb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:11:31.097754 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-4c6a0df7-5d9b-4a82-9a67-5d7b47977cb1 admin admin] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:11:31.098260 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-4c6a0df7-5d9b-4a82-9a67-5d7b47977cb1 admin admin] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:11:31.125886 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-4c6a0df7-5d9b-4a82-9a67-5d7b47977cb1 admin admin] 10.222.0.110 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.088856 Jul 22 22:11:31.126470 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 37/75] 10.222.0.110 () {60 vars in 1199 bytes} [Thu Jul 22 22:11:31 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:11:32.563444 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: DEBUG nova.api.openstack.wsgi [None req-f6691e91-55a4-4bc5-b76c-bbdcf381146b admin admin] Calling method '>' {{(pid=92526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:11:32.564775 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: INFO nova.api.openstack.requestlog [None req-f6691e91-55a4-4bc5-b76c-bbdcf381146b admin admin] 10.222.0.110 "GET /compute/v2.1" status: 200 len: 389 microversion: 2.1 time: 0.002185 Jul 22 22:11:32.565323 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: [pid: 92526|app: 0|req: 39/76] 10.222.0.110 () {56 vars in 1080 bytes} [Thu Jul 22 22:11:32 2021] GET /compute/v2.1 => generated 389 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:11:32.779950 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG nova.api.openstack.wsgi [None req-080922b6-e428-436d-80b8-58448afe2cce admin admin] Calling method '>' {{(pid=92525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:11:32.781170 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:11:32.781170 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: warnings.warn(msg) Jul 22 22:11:32.782756 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-080922b6-e428-436d-80b8-58448afe2cce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:11:32.783200 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-080922b6-e428-436d-80b8-58448afe2cce admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:11:32.784095 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-080922b6-e428-436d-80b8-58448afe2cce admin admin] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:11:32.784559 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: DEBUG oslo_concurrency.lockutils [None req-080922b6-e428-436d-80b8-58448afe2cce admin admin] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:11:32.807525 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: INFO nova.api.openstack.requestlog [None req-080922b6-e428-436d-80b8-58448afe2cce admin admin] 10.222.0.110 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.088103 Jul 22 22:11:32.808700 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: [pid: 92525|app: 0|req: 38/77] 10.222.0.110 () {60 vars in 1199 bytes} [Thu Jul 22 22:11:32 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:12:37.042162 dv-cinder-801868-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 22 22:12:37.043554 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: Thu Jul 22 22:12:37 2021 - graceful shutdown triggered... Jul 22 22:12:37.044045 dv-cinder-801868-2-iscsi devstack@n-api.service[92525]: Gracefully killing worker 1 (pid: 92525)... Jul 22 22:12:37.044464 dv-cinder-801868-2-iscsi devstack@n-api.service[92526]: Gracefully killing worker 2 (pid: 92526)... Jul 22 22:12:38.044074 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: worker 1 buried after 1 seconds Jul 22 22:12:38.044074 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: worker 2 buried after 1 seconds Jul 22 22:12:38.044074 dv-cinder-801868-2-iscsi devstack@n-api.service[92524]: goodbye to uWSGI. Jul 22 22:12:38.045597 dv-cinder-801868-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 22 22:12:38.046158 dv-cinder-801868-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 22 22:12:38.049047 dv-cinder-801868-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 22 22:12:38.059547 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 22 22:12:38 2021] *** Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: nodename: dv-cinder-801868-2-iscsi Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: machine: x86_64 Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: clock source: unix Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: pcre jit disabled Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: detected number of CPU cores: 4 Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: current working directory: / Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: detected binary path: /usr/bin/uwsgi-core Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: your processes number limit is 47680 Jul 22 22:12:38.061272 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: your memory page size is 4096 bytes Jul 22 22:12:38.062190 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: detected max file descriptor number: 2048 Jul 22 22:12:38.062190 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: lock engine: pthread robust mutexes Jul 22 22:12:38.062190 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: thunder lock: enabled Jul 22 22:12:38.062190 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 22 22:12:38.062190 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 22 22:12:38.107645 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: Python main interpreter initialized at 0x55c8aad419c0 Jul 22 22:12:38.107645 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: python threads support enabled Jul 22 22:12:38.107645 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: your server socket listen backlog is limited to 100 connections Jul 22 22:12:38.107645 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: your mercy for graceful operations on workers is 90 seconds Jul 22 22:12:38.108099 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: mapped 403077 bytes (393 KB) for 2 cores Jul 22 22:12:38.108099 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: *** Operational MODE: preforking *** Jul 22 22:12:38.109413 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: *** uWSGI is running in multiple interpreter mode *** Jul 22 22:12:38.109413 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: spawned uWSGI master process (pid: 107485) Jul 22 22:12:38.109660 dv-cinder-801868-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 22 22:12:38.110650 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: spawned uWSGI worker 1 (pid: 107498, cores: 1) Jul 22 22:12:38.110650 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: spawned uWSGI worker 2 (pid: 107499, cores: 1) Jul 22 22:12:38.110650 dv-cinder-801868-2-iscsi devstack@n-api.service[107485]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 22 22:12:40.018302 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 22:12:40.018302 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: from cryptography.utils import int_from_bytes Jul 22 22:12:40.019135 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 22:12:40.019135 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: from cryptography.utils import int_from_bytes Jul 22 22:12:40.030261 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 22:12:40.030261 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: from cryptography.utils import int_from_bytes Jul 22 22:12:40.030952 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 22 22:12:40.030952 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: from cryptography.utils import int_from_bytes Jul 22 22:12:44.491357 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 22 22:12:44.491981 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 22 22:12:44.491981 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 22 22:12:44.492368 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 22 22:12:44.492630 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 22 22:12:44.493021 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.493356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.493680 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.494000 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.494334 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.494654 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.494998 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.495317 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.495650 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.495914 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.496238 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.496596 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801868-2-iscsi {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.496924 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.497240 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.497549 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.497870 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.498240 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.498528 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.498834 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.499334 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.499780 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.500625 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.501113 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.501459 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.501778 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.502120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.502444 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.502765 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.503087 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.503412 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.503807 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801868-2-iscsi {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.504147 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.504473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.504792 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.505217 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.505534 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.505847 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.506172 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.506500 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.506817 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.507150 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.507477 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.507799 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.508143 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.508462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.508777 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.509090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.509415 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.509730 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.510040 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.510298 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.510612 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.510939 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.511264 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.511589 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.511848 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.512104 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.512452 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.512778 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.513099 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.513411 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.513725 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.514049 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.514360 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.514685 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.514998 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.515339 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.516745 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.516745 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.517021 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.517206 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.517528 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.517932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.110 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.518593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.110 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.518593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.518895 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.519145 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.519461 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.519786 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.520113 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.520450 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.520763 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.521075 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.521400 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.521728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.522039 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.522294 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.522601 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.522914 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.523244 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.523557 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.523867 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.524179 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.524514 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.524828 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.525143 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.525453 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.525765 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.526078 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.526389 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.526701 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.527010 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.527322 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.527646 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.527971 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.528308 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.528614 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.528925 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.529235 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.529560 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.529872 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.530181 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.530505 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.530814 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.531202 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.531470 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.531782 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.532093 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.532448 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.532757 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.533072 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.533396 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.533704 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.534017 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.534319 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.534628 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.534936 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.535248 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.535555 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.535866 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.536167 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.536517 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.536838 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.537151 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.537462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.537772 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.538094 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.538504 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.539113 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 22 22:12:44.541434 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.541532 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 22 22:12:44.541630 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.541725 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 22 22:12:44.541900 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.541900 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.542116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 22 22:12:44.542116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 22 22:12:44.542332 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.542437 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.542530 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.542530 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.542754 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.542845 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.542937 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.543033 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.543120 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.543212 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.543306 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.543536 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.543646 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.543734 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.543826 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.543912 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.544003 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.544094 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.544243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.544243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.544430 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.544516 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.544599 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.544684 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801868-2-iscsi {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.544788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.544884 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.544970 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.545062 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.545158 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.545252 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.545346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.545441 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.545530 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.545672 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.545769 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.545869 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.545956 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.546053 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.546150 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.546294 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.546387 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.546608 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.546712 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.546996 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.547099 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.547287 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.547390 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.547611 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.547773 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.547930 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.548094 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.548246 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.548427 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.548586 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.548780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.548967 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.549063 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.549289 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.549406 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.549603 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.549704 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.549945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.550079 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801868-2-iscsi {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.550270 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.550402 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.550590 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.550723 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.550902 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.551041 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.551213 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.551463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.551577 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.551775 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.551869 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.552087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.552180 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.552455 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.552560 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.552780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.552872 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.553093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.553188 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.553427 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.553665 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.553771 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.553864 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.554036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.554132 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.554352 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.554466 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.554661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.554770 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.554971 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.555064 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.555284 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.555384 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.555593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.555697 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.555902 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.555999 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.556217 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.556329 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.556515 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.556624 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.556830 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.556932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.557156 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.557248 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.557462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.557563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.557780 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.557881 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.558026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.558115 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.558272 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.558397 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.558595 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.558712 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.558919 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.559044 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.559231 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.559362 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.559541 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.559677 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.559852 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.560015 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.560163 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.560477 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.560583 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.560671 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.560840 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.560987 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.561151 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.561319 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.561461 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.561643 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.561783 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.561953 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.562101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.562267 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.562427 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.563145 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.563306 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.563467 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.563643 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.563786 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.564037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.110 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.564131 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.564323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.110 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.564457 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.564640 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.564742 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.564985 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.565080 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.565290 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.565390 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.565596 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.565689 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.565920 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.566057 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.566231 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.566324 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.566539 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.566645 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.566847 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.566941 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.567152 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.567258 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.567473 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.567579 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.567794 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.567893 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.568101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.568206 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.568377 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.568483 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.568685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.568786 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.568993 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.569102 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.569315 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.569416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.569625 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.569726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.569934 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.570035 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.570340 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.570485 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.570609 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.570728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.570854 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.570948 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.571163 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.571264 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.571473 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.571566 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.571782 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.571883 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.572095 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.572209 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.572423 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.572532 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.572734 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.572829 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.573042 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.573136 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.573350 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.573448 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.573668 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.573830 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.573996 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.574121 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.574281 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.574432 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.574700 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.574833 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.574926 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.575043 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.575186 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.575327 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.575494 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.575650 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.575832 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.575991 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.576256 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.576415 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.576542 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.576667 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.576915 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.577042 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.577134 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.577219 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.577352 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.577540 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.577693 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.577857 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.578015 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.578229 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.578928 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.579247 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.579439 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.579613 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.579851 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.580004 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.580217 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.580470 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.580610 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.580787 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.580887 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.580975 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.581060 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.581159 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.581247 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.581406 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.581502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.581719 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.581822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.582031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.582129 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.582340 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.582435 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.582649 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.582754 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.582955 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.583048 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.583278 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.583379 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.583604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.583707 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.583984 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.584091 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.584225 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.584355 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.584568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.584732 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.584884 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.584987 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 22 22:12:44.585210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.585326 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.585530 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.585646 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.585839 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.585935 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.586154 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.586249 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.586469 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.586571 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.586781 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.586883 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.587096 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.587203 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.587420 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.587523 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.587731 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.587826 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.588045 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.588150 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.588396 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.588505 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.588716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.588809 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.589034 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.589151 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.589354 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.589458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.589674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.589937 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.590032 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.590274 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.590369 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.590591 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.590689 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.590910 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.591018 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.591232 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.591327 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.591550 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.591641 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.591879 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.592053 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.592201 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.592374 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.592555 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.592650 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.592835 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.592944 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.593151 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.593246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.593460 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.593555 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.593796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.593963 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.594145 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.594294 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.594398 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.594487 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.594697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.594837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.595092 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.595195 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.595407 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.595500 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.595718 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.595819 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.596027 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.596121 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.596356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.596455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.596666 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.596764 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.596986 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.597093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.597294 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.597396 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.597604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.597703 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.597909 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.598002 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.598214 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.598319 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.598527 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.598622 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.598829 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.598922 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.599137 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.599255 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.599446 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.599555 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.599762 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.599855 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.600084 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.600189 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.600422 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.600526 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.600738 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.600840 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.601052 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.601155 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.601360 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.601460 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.601935 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.602036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.602287 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.602392 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.602597 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.602733 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.602911 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.603012 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.603220 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.603341 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.603529 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.603620 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.603839 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.603985 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.604149 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.604344 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.604465 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.604556 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.604791 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.604921 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.605103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.605206 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.605416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.605519 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.605725 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.605819 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.606040 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.606134 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.606350 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.606458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.606662 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.606753 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.606973 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.607072 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.607281 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.607384 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.607589 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.607692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.607902 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.607997 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.608212 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.608351 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.608560 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.608660 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.608873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.608964 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.609181 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.609281 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.609553 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.609662 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.609908 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.610064 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.610259 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.610356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.610532 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.610625 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.610844 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.610937 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.611157 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.611252 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.611464 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.611558 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.611773 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.611880 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.612082 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.612225 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.612433 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.612537 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.612755 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.612903 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.613060 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.613176 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.613365 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.613459 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.613670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.613777 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.613996 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.614098 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.614314 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.614403 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.614619 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.614716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.614970 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.615063 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.615243 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.615339 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.615562 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.615671 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.616046 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.616225 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.616519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.616781 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.616909 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.616997 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.617352 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.617463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.617552 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.617632 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.617796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.617879 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.617879 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.618015 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.618102 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.618182 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.618283 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.618378 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.618614 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.618723 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.618947 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.619150 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.619327 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.619486 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.619642 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.619793 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.619948 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.620158 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.620309 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.620464 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.620565 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.620647 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.620854 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.621008 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.621169 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.621316 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.621503 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.621679 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.621844 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.622017 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.622189 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.622351 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.622527 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.622743 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.622909 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.623053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.623191 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.623322 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.623472 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.623605 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.623755 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.623886 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.624030 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.624161 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.624450 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.624605 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.624751 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.624883 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.625602 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.625740 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.625889 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.626029 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.626176 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.626323 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.626469 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.626611 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.626742 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.626870 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.627016 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.627224 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.627370 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.627518 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.627655 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.627798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.627927 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.628069 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.628224 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.628388 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.628522 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.628667 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.628807 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.628984 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.629119 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.629320 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.629505 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.629654 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.629785 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.629918 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.630059 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.630219 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.630363 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.630535 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.630679 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.630828 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.630967 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.631148 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.631317 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.631510 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.631653 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.631795 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.631937 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.632086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.632235 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.632409 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.632556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.632687 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.632890 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.633032 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.633173 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.633331 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.633476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.633610 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.633750 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.633906 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.634057 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.634222 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.634364 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.634522 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.634662 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.634806 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.634953 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.635157 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.635310 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.635480 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.635632 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.635840 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.636152 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.636430 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.636627 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.636758 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.636895 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.637043 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.637175 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.637312 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.637450 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.637582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.637757 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.637906 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.638092 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.638224 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.638404 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.638545 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.638725 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.638857 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.639033 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.639165 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.639342 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.639484 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.639644 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.639777 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.639947 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.640089 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.640257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.640436 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.640589 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.641414 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.641557 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.641704 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.641847 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.641989 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.642257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.642390 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.642569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.642701 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.642882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.643084 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.643218 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.643359 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.643490 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.643621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.643789 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.643933 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.644099 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.644235 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.644425 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.644556 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.644737 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.644887 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.645063 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.645196 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.645406 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.645553 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.645696 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.645839 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.645971 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.646104 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.646311 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.646498 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.646707 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.646892 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.647026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.647161 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.647295 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.647473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.647685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.647884 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.648016 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.648152 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.648310 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.648471 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.648611 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.648785 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.648929 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.649096 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.649230 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.649404 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.649549 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.649730 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.649871 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.650005 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.650137 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.650368 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.650499 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.650646 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.650786 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.650916 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.651067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.651222 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.651365 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.651513 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.651653 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.651801 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.651958 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.652103 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.652246 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.652504 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.652658 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.652792 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.652924 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.653057 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.653257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.653401 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.653545 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.653679 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.653811 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.653956 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.654086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.654236 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.654378 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.654511 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.654644 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.654801 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.654952 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.655115 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.655266 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.655427 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.655568 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.655745 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.655921 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.656069 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.656243 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.656474 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.656673 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.656891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.657062 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.657208 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.657348 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.657481 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.657616 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.657751 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.657921 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.658131 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.658274 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.658409 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.658552 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.658682 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.658858 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.659013 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.659168 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.659307 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.659476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.659621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.659794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.659943 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.660117 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.660253 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.660466 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.660599 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.660798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.660941 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.661109 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.661241 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.661417 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.661553 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.661724 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.661855 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.662036 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.662202 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.662337 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.662468 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.662643 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.662798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.662940 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.663068 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.663337 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.663553 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.663699 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.663874 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.664007 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.664191 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.664364 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.664551 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.664694 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.664869 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.665011 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.665182 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.665315 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.665510 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.665644 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.665798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.665948 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.666090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.666221 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.666447 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.666582 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.666739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.666911 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.667075 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.667172 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.667385 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.667517 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.667708 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.667984 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.668185 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.668426 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.668605 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.668770 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.668943 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.668943 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.669269 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.669447 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.669611 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.669780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.669925 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.670138 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.670308 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.670483 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.670658 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.670832 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.671004 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.671175 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.671351 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.671522 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.671685 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.671857 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.672185 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.672422 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.672604 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.672759 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.672930 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.673037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.673037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.673228 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.673349 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.673646 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.673745 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.673976 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.674075 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.674294 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.674395 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.674612 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.674712 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.674931 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.675029 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.675247 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.675346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.675565 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.675673 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.675884 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.675987 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.676195 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.676349 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.676536 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.676708 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.676850 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.676956 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.677166 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.677264 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.677462 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.677555 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.677794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.677895 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.678111 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.678202 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.678432 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.678538 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.678733 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.678912 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.679044 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.679144 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.679360 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.679476 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.679670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.679775 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.680056 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.680160 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.680395 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.680510 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.680721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.680814 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.681047 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.681144 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.681365 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.681466 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.681683 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.681781 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.682005 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.682158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.682314 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.682462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.682617 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.682710 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.682949 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.683055 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.683257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.683351 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.683578 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.683670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.683897 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.683988 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.684232 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.684342 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.684573 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.684653 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.684888 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.684979 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.685219 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.685312 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.685531 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.685630 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.685843 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.686007 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.686152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.686374 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.686475 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.686693 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.686873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.687035 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.687135 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.687368 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.687479 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.688493 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.688635 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.688845 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.689121 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.689213 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.689298 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.689382 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.689563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.689657 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.689880 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.689973 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.690193 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.690285 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.690506 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.690600 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.690818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.690911 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.691144 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.691245 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.691461 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.691562 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.691773 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.691874 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.692097 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.692188 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.692434 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.692540 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.692751 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.692975 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.693121 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.693332 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.693485 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.693655 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.693827 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.693990 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.694119 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.694305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.694412 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.694631 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.694732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.694945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.695047 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.695275 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.695388 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.695589 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.695702 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.695978 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.696172 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.696367 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.696472 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.696611 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.696759 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.696914 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.697071 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.697214 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.697369 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.697522 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.697642 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.700332 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.700455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.700545 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.700629 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.700720 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.700813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.700907 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701001 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701001 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701168 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701253 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701342 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701427 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701522 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701608 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701690 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701781 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701865 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.701956 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.702054 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.702146 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.702272 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.702366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.702456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.702616 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.702702 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.702702 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.702868 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.702959 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.703033 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.703139 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.703879 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.704063 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.704195 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.704341 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.704470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.704470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.704676 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.704760 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.704850 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.704935 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.705027 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.705119 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.705209 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.705294 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.705380 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.705464 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.705559 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.705771 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.705876 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.706138 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.706276 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.706413 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.706518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.706765 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.706965 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.707185 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.707283 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.707378 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.707625 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.707780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.708021 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.708105 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.708428 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.708622 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.708725 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.708967 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.709059 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.709297 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.709387 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.709620 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.709711 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.709935 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.710028 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.710249 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.710348 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.710562 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.710655 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.710872 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.710970 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.711197 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.711289 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.711503 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.711594 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.711818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.711909 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.712132 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.712245 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.712466 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.712602 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.712779 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.712873 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.713087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.713192 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.713399 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.713491 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.713714 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.713806 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.714031 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.714154 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.714347 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.714489 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.714670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.714760 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.715042 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.715152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.715317 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.715407 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.715635 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.715732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.715956 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.716054 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.716269 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.716389 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.716605 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.716698 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.716918 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.717018 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.717238 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.717344 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.717555 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.717653 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.717873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.717973 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.718187 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.718334 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.718591 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.718710 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.718971 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.719099 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.719398 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.719624 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.719714 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.719973 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.720089 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.720215 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.720360 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.720563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.720701 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.720881 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.721068 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.721196 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.721385 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.721660 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.722163 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.722923 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.723439 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.724123 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.724941 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.725561 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.726320 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.727163 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.727736 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.728507 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.729117 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.729746 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.729850 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.729938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.730022 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.730105 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.730188 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.730280 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.730366 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.730449 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.730533 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.730660 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.730752 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.730851 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.730938 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.731028 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.731112 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.731203 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.731290 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.731387 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.731473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.731557 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.731640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.731730 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.731870 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.731958 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.732041 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.732124 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.732220 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.732334 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.732434 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.732521 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.732611 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.732697 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.732822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.732914 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.733007 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.733094 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.733182 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.733266 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.733348 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.733439 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.733569 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.733697 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.733794 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.733880 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.733963 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.734056 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.734141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.734233 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.734325 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.734476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.734588 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.734959 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.735261 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.735396 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.735526 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.735526 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.735719 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.735813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.735899 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.735983 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.736067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.736158 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.736252 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.736419 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.736549 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.736642 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.736735 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.736819 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.736819 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.737069 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.737164 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.737250 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.737375 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.737475 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.737573 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.737667 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.737753 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.737882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.738020 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.738116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.738209 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.738295 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.738378 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.738506 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.738598 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.738692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.738784 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.738876 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.738948 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.739018 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.739365 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.739456 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.739529 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.739599 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.739721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.739813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.739907 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.739907 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.740072 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.740155 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.740246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.740354 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.740454 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.740541 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.740625 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.740747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.740839 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.740923 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.741015 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.741108 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.741201 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.741456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.741563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.741752 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.741929 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.742083 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.742176 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.742332 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 22 22:12:44.742426 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.742685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.743001 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.743315 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.743725 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.743938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.744246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.744601 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.744913 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.745221 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.745530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.745846 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.746155 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.746466 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.746775 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.747084 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.747401 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.747711 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.748026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.748360 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.748679 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.748988 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.749304 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.749610 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.749942 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.750835 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.751102 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.751424 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.751826 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.752072 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.752413 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.752733 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.753305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.753632 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.754198 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.754539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.754868 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.755222 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.755571 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.755888 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.756204 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.756571 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.756904 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.757221 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.757540 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.757859 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.758176 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.758486 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.758800 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.759114 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.759435 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.759744 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.760059 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.760440 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.760765 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.761264 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.761741 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.762132 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.762463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.762784 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.763101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.763440 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.763760 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.764100 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.764452 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.764769 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.765199 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.765519 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.766463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.766677 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_db.sqlalchemy.engines [None req-805ec657-292c-4523-9f20-86187b244344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:12:44.766898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.767092 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.767478 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.767772 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.768245 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.768494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.768781 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.769091 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.769402 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.769806 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.770194 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.770505 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.770829 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.771220 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.771477 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.771798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.772115 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.772458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.772775 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.773089 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.773416 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.773727 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.774049 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.774361 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.774686 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.775002 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.775322 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.775630 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.775947 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.776262 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.776604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.776947 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.777260 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.777589 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.777903 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.778230 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.778542 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.778867 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.779189 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.779515 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.779826 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.780161 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.780515 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.780827 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.781143 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.781576 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.781909 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.782317 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.782648 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.782986 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.783299 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.783628 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.783947 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.784301 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.784616 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.784927 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.785266 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.785578 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.785897 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.786211 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.786523 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.786846 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.787162 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.787495 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.787831 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.788146 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.788501 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.788862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.789183 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.789528 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.789863 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 22 22:12:44.790110 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107499) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 22 22:12:44.821470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_db.sqlalchemy.engines [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:12:44.940191 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.context [None req-805ec657-292c-4523-9f20-86187b244344 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5f4ff4e-504c-4af6-92c6-2f1d71fba296(cell1) {{(pid=107498) load_cells /opt/stack/nova/nova/context.py:464}} Jul 22 22:12:44.944723 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-805ec657-292c-4523-9f20-86187b244344 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:12:44.946338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-805ec657-292c-4523-9f20-86187b244344 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:12:44.947161 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-805ec657-292c-4523-9f20-86187b244344 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:12:44.949360 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-805ec657-292c-4523-9f20-86187b244344 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:12:44.961342 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_db.sqlalchemy.engines [None req-805ec657-292c-4523-9f20-86187b244344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:12:44.966382 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_db.sqlalchemy.engines [None req-805ec657-292c-4523-9f20-86187b244344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:12:45.002658 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.context [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d5f4ff4e-504c-4af6-92c6-2f1d71fba296(cell1) {{(pid=107499) load_cells /opt/stack/nova/nova/context.py:464}} Jul 22 22:12:45.007476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:12:45.009169 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:12:45.010009 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:12:45.012001 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:12:45.026443 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_db.sqlalchemy.engines [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:12:45.028269 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_db.sqlalchemy.engines [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:12:45.247495 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_db.sqlalchemy.engines [None req-805ec657-292c-4523-9f20-86187b244344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:12:45.318640 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_db.sqlalchemy.engines [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107499) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 22 22:12:45.602066 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: WARNING keystonemiddleware.auth_token [None req-805ec657-292c-4523-9f20-86187b244344 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 22:12:45.608669 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: WARNING keystonemiddleware.auth_token [None req-805ec657-292c-4523-9f20-86187b244344 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 22:12:45.661045 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: WARNING keystonemiddleware.auth_token [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 22:12:45.667648 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: WARNING keystonemiddleware.auth_token [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 22:12:45.984326 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: WARNING keystonemiddleware.auth_token [None req-805ec657-292c-4523-9f20-86187b244344 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 22:12:45.991054 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: WARNING keystonemiddleware.auth_token [None req-805ec657-292c-4523-9f20-86187b244344 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 22:12:45.995946 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55c8aad419c0 pid: 107498 (default app) Jul 22 22:12:46.029087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: WARNING keystonemiddleware.auth_token [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 22 22:12:46.034987 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: WARNING keystonemiddleware.auth_token [None req-3d226bdc-1e2f-4352-b123-f65d49faa8b0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 22 22:12:46.040465 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55c8aad419c0 pid: 107499 (default app) Jul 22 22:13:24.345406 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c9ec905b-c9df-40c7-8377-69239ff29c03 tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] Calling method '.version_select at 0x7f7d196410d0>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:27.141137 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c9ec905b-c9df-40c7-8377-69239ff29c03 tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/2fafa987-c569-4b7a-86aa-ccfed54c86a9" status: 200 len: 351 microversion: 2.1 time: 3.159331 Jul 22 22:13:27.142063 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 1/1] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:13:23 2021] GET /compute/v2.1/os-volumes/2fafa987-c569-4b7a-86aa-ccfed54c86a9 => generated 351 bytes in 3162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:13:27.518463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2018346218", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "networks": [{"uuid": "1a2c4567-b907-434f-9715-3d7a3808ccec"}]}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:13:27.728241 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1050848787", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "networks": [{"uuid": "2efa360b-cc3d-49e4-a8a0-1edcaa3e915e"}]}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:13:28.136888 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.network.neutron [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] validate_networks() for [('2efa360b-cc3d-49e4-a8a0-1edcaa3e915e', None, None, None)] {{(pid=107498) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:13:28.492412 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.network.neutron [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] validate_networks() for [('1a2c4567-b907-434f-9715-3d7a3808ccec', None, None, None)] {{(pid=107499) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:13:30.714198 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Flavor limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:13:30.715289 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Image limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:13:30.715926 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Flavor pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:13:30.716710 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Image pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:13:30.717517 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:13:30.773596 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:30.775365 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:30.778382 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:30.778844 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:30.789369 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Flavor limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:13:30.791406 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Image limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:13:30.792221 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Flavor pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:13:30.792938 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Image pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:13:30.793786 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:13:30.843019 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:30.850691 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:30.855756 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:30.856862 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:30.873837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Getting quotas for project 131c422049c5444aa188ba5e9a4efc0f. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:13:30.897278 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Getting quotas for user af9c4420654d44379c06e0e33695b403 and project 131c422049c5444aa188ba5e9a4efc0f. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:13:30.942763 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Going to run 1 instances... {{(pid=107499) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:13:30.958589 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107499) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:13:31.014225 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Getting quotas for project 71bffb8e6c93437cb3fdbc82d8300750. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:13:31.033946 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Getting quotas for user 7438b1d834bd4e5f91ae4169e6b3a543 and project 71bffb8e6c93437cb3fdbc82d8300750. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:13:31.059697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Going to run 1 instances... {{(pid=107498) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:13:31.104783 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:13:31.206279 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2a4eea92-b95b-438a-bed7-d794e5cfa06c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 4.878396 Jul 22 22:13:31.212952 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 1/2] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:13:26 2021] POST /compute/v2.1/servers => generated 382 bytes in 4887 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:13:31.223961 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1286fa72-ec05-4b2c-a5b8-9543c4dd682e tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] Calling method '.version_select at 0x7f7d1945cdc0>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:31.482637 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6599e647-4c73-4a61-bd8d-c9a0572de4d2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 3.931184 Jul 22 22:13:31.493836 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 2/3] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:13:27 2021] POST /compute/v2.1/servers => generated 382 bytes in 3943 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:13:31.509229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-316767d0-742b-4989-916b-47e953a5ef0c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:31.513269 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-316767d0-742b-4989-916b-47e953a5ef0c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:31.585996 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1286fa72-ec05-4b2c-a5b8-9543c4dd682e tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/395ee7bc-3142-4966-8a72-b2fb9636cb6e" status: 200 len: 351 microversion: 2.1 time: 0.371635 Jul 22 22:13:31.587137 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 2/4] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:13:31 2021] GET /compute/v2.1/os-volumes/395ee7bc-3142-4966-8a72-b2fb9636cb6e => generated 351 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:13:31.591998 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-99dff16a-c573-4f79-9a68-44c14642b03c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:31.593040 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-99dff16a-c573-4f79-9a68-44c14642b03c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:31.896740 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-316767d0-742b-4989-916b-47e953a5ef0c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:31.920859 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-316767d0-742b-4989-916b-47e953a5ef0c tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1219 microversion: 2.1 time: 0.424437 Jul 22 22:13:31.921772 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 3/5] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:31 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1219 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:31.983793 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-99dff16a-c573-4f79-9a68-44c14642b03c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:32.027036 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-99dff16a-c573-4f79-9a68-44c14642b03c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1222 microversion: 2.1 time: 0.438127 Jul 22 22:13:32.033376 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 3/6] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:31 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1222 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:32.940606 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-831c1469-3c7b-472c-b49e-ebd317c343be tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:32.941442 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-831c1469-3c7b-472c-b49e-ebd317c343be tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:33.050535 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fd3ab778-5e97-4c37-b9cb-599c47d69d2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:33.051446 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fd3ab778-5e97-4c37-b9cb-599c47d69d2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:33.325652 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-831c1469-3c7b-472c-b49e-ebd317c343be tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:33.339321 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-831c1469-3c7b-472c-b49e-ebd317c343be tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1219 microversion: 2.1 time: 0.404029 Jul 22 22:13:33.343403 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 4/7] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:32 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1219 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:33.624601 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fd3ab778-5e97-4c37-b9cb-599c47d69d2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:33.632471 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fd3ab778-5e97-4c37-b9cb-599c47d69d2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1222 microversion: 2.1 time: 0.586076 Jul 22 22:13:33.633118 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 4/8] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:33 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1222 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:13:34.202266 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0b2ca74d-396d-4219-b670-40350d0476ce tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] Calling method '.version_select at 0x7f7d193c3c10>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:34.332627 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0b2ca74d-396d-4219-b670-40350d0476ce tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/d1258564-bb6d-4a21-947b-f003bd59e252" status: 200 len: 350 microversion: 2.1 time: 0.133945 Jul 22 22:13:34.347066 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 5/9] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:13:34 2021] GET /compute/v2.1/os-volumes/d1258564-bb6d-4a21-947b-f003bd59e252 => generated 350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:13:34.361613 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6629214f-499a-4ddf-a7b3-eb5b63e0ce50 tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] Calling method '.version_select at 0x7f7d18b869d0>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:34.686622 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-78c8af5d-a93e-4202-bafb-e4dd1ba3b2f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'create', calling method: .version_select at 0x7f7d19e87af0>, body: {"keypair": {"name": "tempest-keypair-1853979202"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:13:34.723769 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6629214f-499a-4ddf-a7b3-eb5b63e0ce50 tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] 10.222.0.110 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.372880 Jul 22 22:13:34.725799 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 6/10] 10.222.0.110 () {58 vars in 1139 bytes} [Thu Jul 22 22:13:34 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:34.744063 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f83eaee9-0121-4f39-a82e-36cc5d59b647 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:34.748763 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f83eaee9-0121-4f39-a82e-36cc5d59b647 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:34.799209 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-78c8af5d-a93e-4202-bafb-e4dd1ba3b2f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for project 93164c7b18524c7f9483aa0383349cb9. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:13:34.812445 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-78c8af5d-a93e-4202-bafb-e4dd1ba3b2f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for user b1d770b6425649559463a5d37c3f3a3f and project 93164c7b18524c7f9483aa0383349cb9. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:13:34.954279 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f83eaee9-0121-4f39-a82e-36cc5d59b647 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:34.969911 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f83eaee9-0121-4f39-a82e-36cc5d59b647 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1219 microversion: 2.1 time: 0.230789 Jul 22 22:13:34.970926 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 7/11] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:34 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1219 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:34.984375 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4325ca4f-b23e-4434-8417-e7b0818b1544 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:34.986089 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4325ca4f-b23e-4434-8417-e7b0818b1544 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:35.002365 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4325ca4f-b23e-4434-8417-e7b0818b1544 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:35.002835 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4325ca4f-b23e-4434-8417-e7b0818b1544 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:35.003644 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4325ca4f-b23e-4434-8417-e7b0818b1544 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:35.004086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4325ca4f-b23e-4434-8417-e7b0818b1544 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:35.450733 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4325ca4f-b23e-4434-8417-e7b0818b1544 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:35.488256 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4325ca4f-b23e-4434-8417-e7b0818b1544 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1274 microversion: 2.1 time: 0.512501 Jul 22 22:13:35.491966 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 8/12] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:34 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1274 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:35.515132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-39547415-f14b-4293-be90-1b5d876a73af tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] Calling method '.version_select at 0x7f7d18b1dee0>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:35.825012 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-39547415-f14b-4293-be90-1b5d876a73af tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] 10.222.0.110 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.328124 Jul 22 22:13:35.825594 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 9/13] 10.222.0.110 () {58 vars in 1154 bytes} [Thu Jul 22 22:13:35 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:13:35.838277 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-46ed2b1d-9dcd-46e9-aae6-5b02a387f3e8 tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] Calling method '.version_select at 0x7f7d18b72c10>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:35.935465 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-78c8af5d-a93e-4202-bafb-e4dd1ba3b2f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for project 93164c7b18524c7f9483aa0383349cb9. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:13:35.947035 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-78c8af5d-a93e-4202-bafb-e4dd1ba3b2f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for user b1d770b6425649559463a5d37c3f3a3f and project 93164c7b18524c7f9483aa0383349cb9. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:13:35.991486 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-78c8af5d-a93e-4202-bafb-e4dd1ba3b2f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.738553 Jul 22 22:13:35.995157 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 5/14] 10.222.0.110 () {60 vars in 1163 bytes} [Thu Jul 22 22:13:34 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:36.007083 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-332748fe-da59-4121-97ee-3bd44e765880 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:36.018155 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-332748fe-da59-4121-97ee-3bd44e765880 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:36.054336 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-332748fe-da59-4121-97ee-3bd44e765880 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:36.055242 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-332748fe-da59-4121-97ee-3bd44e765880 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:36.056240 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-332748fe-da59-4121-97ee-3bd44e765880 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:36.056941 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-332748fe-da59-4121-97ee-3bd44e765880 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:36.131585 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-46ed2b1d-9dcd-46e9-aae6-5b02a387f3e8 tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] 10.222.0.110 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.296277 Jul 22 22:13:36.133706 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 10/15] 10.222.0.110 () {58 vars in 1139 bytes} [Thu Jul 22 22:13:35 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:13:36.162076 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-822f661b-fb89-49db-9689-6376d59285ec tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] Calling method '.version_select at 0x7f7d18b72040>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:36.416403 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-822f661b-fb89-49db-9689-6376d59285ec tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] 10.222.0.110 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.275054 Jul 22 22:13:36.418203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 11/16] 10.222.0.110 () {58 vars in 1172 bytes} [Thu Jul 22 22:13:36 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:13:36.430939 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8b686130-20bf-4f38-8904-e88f1af09365 tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] Calling method '.version_select at 0x7f7d19e87820>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:36.561113 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8b686130-20bf-4f38-8904-e88f1af09365 tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.134275 Jul 22 22:13:36.570302 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 12/17] 10.222.0.110 () {58 vars in 1175 bytes} [Thu Jul 22 22:13:36 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:13:36.576001 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e0762d71-c37f-4420-a03f-038d094feeb3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:36.576822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e0762d71-c37f-4420-a03f-038d094feeb3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:36.587504 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e0762d71-c37f-4420-a03f-038d094feeb3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:36.588605 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e0762d71-c37f-4420-a03f-038d094feeb3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:36.591870 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e0762d71-c37f-4420-a03f-038d094feeb3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:36.595057 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e0762d71-c37f-4420-a03f-038d094feeb3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:36.746907 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-332748fe-da59-4121-97ee-3bd44e765880 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:36.794494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-332748fe-da59-4121-97ee-3bd44e765880 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1271 microversion: 2.1 time: 0.797882 Jul 22 22:13:36.799842 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 6/18] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:35 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1271 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:36.815396 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d929341a-ff4c-4578-8e59-2675863a87ed tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] Calling method '.version_select at 0x7f7d182edaf0>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:36.941442 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e0762d71-c37f-4420-a03f-038d094feeb3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:36.955902 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e0762d71-c37f-4420-a03f-038d094feeb3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1280 microversion: 2.1 time: 0.383460 Jul 22 22:13:36.956537 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 13/19] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:36 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1280 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:37.148200 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d929341a-ff4c-4578-8e59-2675863a87ed tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.346115 Jul 22 22:13:37.148990 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 7/20] 10.222.0.110 () {58 vars in 1160 bytes} [Thu Jul 22 22:13:36 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:37.175319 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9ab1d76c-bbb4-4c27-b7a2-9c82cad0af16 tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] Calling method '.version_select at 0x7f7d18b72b80>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:37.597175 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9ab1d76c-bbb4-4c27-b7a2-9c82cad0af16 tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.434888 Jul 22 22:13:37.610835 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 14/21] 10.222.0.110 () {58 vars in 1193 bytes} [Thu Jul 22 22:13:37 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:13:37.625022 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2f786683-169d-44e3-97d6-94ce5abce08c tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] Calling method '.version_select at 0x7f7d19e879d0>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:37.793973 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2f786683-169d-44e3-97d6-94ce5abce08c tempest-VolumesTestJSON-2120082070 tempest-VolumesTestJSON-2120082070-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.181297 Jul 22 22:13:37.800436 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 8/22] 10.222.0.110 () {58 vars in 1160 bytes} [Thu Jul 22 22:13:37 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:37.823625 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-584485f3-adbf-4892-8ffa-85f2d7ec9072 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:37.825385 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-584485f3-adbf-4892-8ffa-85f2d7ec9072 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:37.842130 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-584485f3-adbf-4892-8ffa-85f2d7ec9072 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:37.843437 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-584485f3-adbf-4892-8ffa-85f2d7ec9072 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:37.845642 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-584485f3-adbf-4892-8ffa-85f2d7ec9072 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:37.847726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-584485f3-adbf-4892-8ffa-85f2d7ec9072 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:37.988682 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1a5fa362-e910-49f7-a5ce-917822baee2f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:37.989929 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1a5fa362-e910-49f7-a5ce-917822baee2f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:38.066728 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1a5fa362-e910-49f7-a5ce-917822baee2f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:38.069810 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1a5fa362-e910-49f7-a5ce-917822baee2f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:38.077550 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1a5fa362-e910-49f7-a5ce-917822baee2f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:38.078046 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1a5fa362-e910-49f7-a5ce-917822baee2f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:38.342925 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1a5fa362-e910-49f7-a5ce-917822baee2f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:38.367259 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1a5fa362-e910-49f7-a5ce-917822baee2f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1280 microversion: 2.1 time: 0.387661 Jul 22 22:13:38.379141 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 9/23] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:37 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1280 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:38.722143 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-584485f3-adbf-4892-8ffa-85f2d7ec9072 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:38.738900 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-584485f3-adbf-4892-8ffa-85f2d7ec9072 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1277 microversion: 2.1 time: 0.924675 Jul 22 22:13:38.745200 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 15/24] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:37 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1277 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:39.387086 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b3e6e48e-af44-4dcc-9701-e86152a15bd5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:39.387714 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b3e6e48e-af44-4dcc-9701-e86152a15bd5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:39.400346 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b3e6e48e-af44-4dcc-9701-e86152a15bd5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:39.406256 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b3e6e48e-af44-4dcc-9701-e86152a15bd5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:39.407768 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b3e6e48e-af44-4dcc-9701-e86152a15bd5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:39.413585 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b3e6e48e-af44-4dcc-9701-e86152a15bd5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:39.761526 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d0534c63-31c4-4841-ba85-d11141b04634 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:39.762968 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d0534c63-31c4-4841-ba85-d11141b04634 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:39.803826 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d0534c63-31c4-4841-ba85-d11141b04634 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:39.828087 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d0534c63-31c4-4841-ba85-d11141b04634 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:39.829167 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d0534c63-31c4-4841-ba85-d11141b04634 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:39.829966 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d0534c63-31c4-4841-ba85-d11141b04634 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:39.941927 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b3e6e48e-af44-4dcc-9701-e86152a15bd5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:40.017955 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b3e6e48e-af44-4dcc-9701-e86152a15bd5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1280 microversion: 2.1 time: 0.615414 Jul 22 22:13:40.037529 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 10/25] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:39 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1280 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:40.601032 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d0534c63-31c4-4841-ba85-d11141b04634 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:40.620081 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d0534c63-31c4-4841-ba85-d11141b04634 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1277 microversion: 2.1 time: 0.863115 Jul 22 22:13:40.645810 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 16/26] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:39 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1277 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:41.049920 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2136ef8e-bd0a-4745-bb20-15f6b49839e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:41.051054 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2136ef8e-bd0a-4745-bb20-15f6b49839e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:41.088870 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2136ef8e-bd0a-4745-bb20-15f6b49839e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:41.118134 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2136ef8e-bd0a-4745-bb20-15f6b49839e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:41.123724 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2136ef8e-bd0a-4745-bb20-15f6b49839e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:41.130361 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2136ef8e-bd0a-4745-bb20-15f6b49839e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:41.647565 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f1d3ca49-20f6-4a92-9a13-cd23865c8336 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:41.648881 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f1d3ca49-20f6-4a92-9a13-cd23865c8336 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:41.663325 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f1d3ca49-20f6-4a92-9a13-cd23865c8336 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:41.663860 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f1d3ca49-20f6-4a92-9a13-cd23865c8336 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:41.665429 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f1d3ca49-20f6-4a92-9a13-cd23865c8336 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:41.671447 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f1d3ca49-20f6-4a92-9a13-cd23865c8336 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:41.742106 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2136ef8e-bd0a-4745-bb20-15f6b49839e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:41.757412 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2136ef8e-bd0a-4745-bb20-15f6b49839e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.714420 Jul 22 22:13:41.758640 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 11/27] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:41 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:42.110755 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f1d3ca49-20f6-4a92-9a13-cd23865c8336 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:42.121713 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f1d3ca49-20f6-4a92-9a13-cd23865c8336 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1277 microversion: 2.1 time: 0.477783 Jul 22 22:13:42.125018 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 17/28] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:41 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1277 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:42.794821 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0d4b2976-9c60-4416-aa73-b4f4a976025f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:42.810329 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0d4b2976-9c60-4416-aa73-b4f4a976025f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:42.858616 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d4b2976-9c60-4416-aa73-b4f4a976025f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:42.860375 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d4b2976-9c60-4416-aa73-b4f4a976025f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:42.862111 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d4b2976-9c60-4416-aa73-b4f4a976025f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:42.869601 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d4b2976-9c60-4416-aa73-b4f4a976025f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:43.150230 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-85a78dc2-f099-4325-ba29-0ac59fd6b8bc tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:43.153371 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-85a78dc2-f099-4325-ba29-0ac59fd6b8bc tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:43.170842 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-85a78dc2-f099-4325-ba29-0ac59fd6b8bc tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:43.172911 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-85a78dc2-f099-4325-ba29-0ac59fd6b8bc tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:43.176149 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-85a78dc2-f099-4325-ba29-0ac59fd6b8bc tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:43.177498 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-85a78dc2-f099-4325-ba29-0ac59fd6b8bc tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:43.529088 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0d4b2976-9c60-4416-aa73-b4f4a976025f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:43.548085 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0d4b2976-9c60-4416-aa73-b4f4a976025f tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.773639 Jul 22 22:13:43.549149 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 12/29] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:42 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:43.634518 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-85a78dc2-f099-4325-ba29-0ac59fd6b8bc tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:43.665462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-85a78dc2-f099-4325-ba29-0ac59fd6b8bc tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1277 microversion: 2.1 time: 0.523128 Jul 22 22:13:43.670721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 18/30] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:43 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1277 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:13:44.566094 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2386cebb-7269-4f17-974a-210c215b4ec9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:44.566818 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2386cebb-7269-4f17-974a-210c215b4ec9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:44.577145 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2386cebb-7269-4f17-974a-210c215b4ec9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:44.580777 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2386cebb-7269-4f17-974a-210c215b4ec9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:44.581900 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2386cebb-7269-4f17-974a-210c215b4ec9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:44.584562 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2386cebb-7269-4f17-974a-210c215b4ec9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:44.700598 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9ba11490-7439-4f61-b7fe-c7b6658e961b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:44.701359 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9ba11490-7439-4f61-b7fe-c7b6658e961b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:44.715995 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9ba11490-7439-4f61-b7fe-c7b6658e961b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:44.718379 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9ba11490-7439-4f61-b7fe-c7b6658e961b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:44.721673 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9ba11490-7439-4f61-b7fe-c7b6658e961b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:44.722303 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9ba11490-7439-4f61-b7fe-c7b6658e961b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:45.393396 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2386cebb-7269-4f17-974a-210c215b4ec9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:45.433518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2386cebb-7269-4f17-974a-210c215b4ec9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.871559 Jul 22 22:13:45.463956 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 13/31] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:44 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:46.015463 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9ba11490-7439-4f61-b7fe-c7b6658e961b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:46.043921 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9ba11490-7439-4f61-b7fe-c7b6658e961b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 1.344005 Jul 22 22:13:46.079949 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 19/32] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:44 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:13:46.487437 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-51150053-59bf-4a49-a03c-a1c432aad291 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:46.487437 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-51150053-59bf-4a49-a03c-a1c432aad291 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:46.499743 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51150053-59bf-4a49-a03c-a1c432aad291 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:46.500241 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51150053-59bf-4a49-a03c-a1c432aad291 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:46.521375 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51150053-59bf-4a49-a03c-a1c432aad291 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:46.524633 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51150053-59bf-4a49-a03c-a1c432aad291 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:46.557486 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8a126104-0015-4cb1-a29c-d1ef3b0fbbf3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'create', calling method: .version_select at 0x7f7d182bf4c0>, body: {"keypair": {"name": "tempest-keypair-2099399197"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:13:46.615454 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-8a126104-0015-4cb1-a29c-d1ef3b0fbbf3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:13:46.632519 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-8a126104-0015-4cb1-a29c-d1ef3b0fbbf3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for user b12a8e4c8635473d9973af215bcbcc46 and project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:13:46.986701 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-8a126104-0015-4cb1-a29c-d1ef3b0fbbf3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:13:46.998537 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-8a126104-0015-4cb1-a29c-d1ef3b0fbbf3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for user b12a8e4c8635473d9973af215bcbcc46 and project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:13:47.034046 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8a126104-0015-4cb1-a29c-d1ef3b0fbbf3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.979908 Jul 22 22:13:47.040885 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 14/33] 10.222.0.110 () {62 vars in 1204 bytes} [Thu Jul 22 22:13:46 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 987 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 22 22:13:47.100668 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-51b62c01-2063-43c8-bcab-889d494c33b8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:47.104169 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-51b62c01-2063-43c8-bcab-889d494c33b8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:47.122703 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-51b62c01-2063-43c8-bcab-889d494c33b8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:47.124543 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-51b62c01-2063-43c8-bcab-889d494c33b8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:47.127797 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-51b62c01-2063-43c8-bcab-889d494c33b8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:47.128844 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-51b62c01-2063-43c8-bcab-889d494c33b8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:47.944640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-51150053-59bf-4a49-a03c-a1c432aad291 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:47.964933 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-51150053-59bf-4a49-a03c-a1c432aad291 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 1.487392 Jul 22 22:13:47.965696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 20/34] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:46 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:48.988322 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-dac3b705-0c3f-4916-8deb-8a6e47e086ad tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:48.988813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-dac3b705-0c3f-4916-8deb-8a6e47e086ad tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:49.019542 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dac3b705-0c3f-4916-8deb-8a6e47e086ad tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:49.020073 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dac3b705-0c3f-4916-8deb-8a6e47e086ad tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:49.037226 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dac3b705-0c3f-4916-8deb-8a6e47e086ad tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:49.043146 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dac3b705-0c3f-4916-8deb-8a6e47e086ad tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:49.045932 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-51b62c01-2063-43c8-bcab-889d494c33b8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:49.056490 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-51b62c01-2063-43c8-bcab-889d494c33b8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 1.959423 Jul 22 22:13:49.068178 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 15/35] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:47 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:13:50.138658 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-70f3d10d-d011-4585-94dd-5706e83ae798 req-28d70981-e6fb-454b-be21-77b93fe47558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73570a19-27c7-4bdc-b64c-a0c5e008ff3f", "tag": "8c0d6a5f-9b31-4e52-a742-c404c46232c7"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:13:50.156166 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:13:50.156166 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:13:50.216625 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-70f3d10d-d011-4585-94dd-5706e83ae798 req-28d70981-e6fb-454b-be21-77b93fe47558 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:50.216886 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-70f3d10d-d011-4585-94dd-5706e83ae798 req-28d70981-e6fb-454b-be21-77b93fe47558 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:50.259261 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-70f3d10d-d011-4585-94dd-5706e83ae798 req-28d70981-e6fb-454b-be21-77b93fe47558 service nova] Creating event network-changed:8c0d6a5f-9b31-4e52-a742-c404c46232c7 for instance 73570a19-27c7-4bdc-b64c-a0c5e008ff3f on hv-cinder-80186 Jul 22 22:13:50.259955 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-70f3d10d-d011-4585-94dd-5706e83ae798 req-28d70981-e6fb-454b-be21-77b93fe47558 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107499) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 22 22:13:50.261196 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-381001c0-2448-4cc7-be87-9b4add692295 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:50.261652 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-381001c0-2448-4cc7-be87-9b4add692295 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:50.262463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-381001c0-2448-4cc7-be87-9b4add692295 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:50.262900 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-381001c0-2448-4cc7-be87-9b4add692295 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:50.297500 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.compute.rpcapi [None req-381001c0-2448-4cc7-be87-9b4add692295 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 22 22:13:50.298433 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-381001c0-2448-4cc7-be87-9b4add692295 None None] Releasing lock "compute-rpcapi-router" {{(pid=107499) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 22 22:13:50.353905 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-381001c0-2448-4cc7-be87-9b4add692295 None None] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.400986 Jul 22 22:13:50.354551 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 16/36] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:13:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:13:50.361552 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5700f0ff-2956-4b1e-b064-c3fe3777f9ed tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:50.369077 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5700f0ff-2956-4b1e-b064-c3fe3777f9ed tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:50.380995 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5700f0ff-2956-4b1e-b064-c3fe3777f9ed tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:50.381797 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5700f0ff-2956-4b1e-b064-c3fe3777f9ed tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:50.385069 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5700f0ff-2956-4b1e-b064-c3fe3777f9ed tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:50.385828 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5700f0ff-2956-4b1e-b064-c3fe3777f9ed tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:50.521415 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-dac3b705-0c3f-4916-8deb-8a6e47e086ad tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:50.529779 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-dac3b705-0c3f-4916-8deb-8a6e47e086ad tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 1.549605 Jul 22 22:13:50.542737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 21/37] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:48 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:50.555258 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1424440543", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dcfbf64-3926-45d8-838a-8c062184c27a"}], "security_groups": [{"name": "tempest-securitygroup--1973209118"}], "key_name": "tempest-keypair-1853979202", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:13:51.527189 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.network.neutron [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] validate_networks() for [('5dcfbf64-3926-45d8-838a-8c062184c27a', None, None, None)] {{(pid=107498) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:13:51.737791 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5700f0ff-2956-4b1e-b064-c3fe3777f9ed tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:51.837022 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5700f0ff-2956-4b1e-b064-c3fe3777f9ed tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 1.477191 Jul 22 22:13:51.854291 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 17/38] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:50 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:53.167174 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-e1a7a2d0-bce1-4124-8bc2-c16bc316ef5e req-79340f76-d579-43a2-9d5d-cd230c3e2f5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d6bddb6-47da-429e-9c5d-d9e1d50b4245", "tag": "30112f59-0c99-4523-9a13-983baff94680"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:13:53.174226 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:13:53.174226 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:13:53.203160 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-e1a7a2d0-bce1-4124-8bc2-c16bc316ef5e req-79340f76-d579-43a2-9d5d-cd230c3e2f5b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:53.216074 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-e1a7a2d0-bce1-4124-8bc2-c16bc316ef5e req-79340f76-d579-43a2-9d5d-cd230c3e2f5b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:53.244459 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-e1a7a2d0-bce1-4124-8bc2-c16bc316ef5e req-79340f76-d579-43a2-9d5d-cd230c3e2f5b service nova] Creating event network-changed:30112f59-0c99-4523-9a13-983baff94680 for instance 4d6bddb6-47da-429e-9c5d-d9e1d50b4245 on hv-cinder-80186 Jul 22 22:13:53.256735 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-e1a7a2d0-bce1-4124-8bc2-c16bc316ef5e req-79340f76-d579-43a2-9d5d-cd230c3e2f5b service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.396218 Jul 22 22:13:53.258646 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 18/39] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:13:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:13:53.271244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2975ec43-9959-4189-881f-c81be071fa2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:53.273055 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2975ec43-9959-4189-881f-c81be071fa2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:53.282830 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2975ec43-9959-4189-881f-c81be071fa2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:53.283943 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2975ec43-9959-4189-881f-c81be071fa2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:53.285271 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2975ec43-9959-4189-881f-c81be071fa2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:53.289021 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2975ec43-9959-4189-881f-c81be071fa2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:54.133210 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2975ec43-9959-4189-881f-c81be071fa2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:54.143683 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2975ec43-9959-4189-881f-c81be071fa2c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.883205 Jul 22 22:13:54.147036 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 19/40] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:53 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:54.168413 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-49cbe113-f4aa-49fd-8320-5b87eac55b79 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:54.171961 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-49cbe113-f4aa-49fd-8320-5b87eac55b79 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:54.181975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49cbe113-f4aa-49fd-8320-5b87eac55b79 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:54.182272 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49cbe113-f4aa-49fd-8320-5b87eac55b79 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:54.183055 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49cbe113-f4aa-49fd-8320-5b87eac55b79 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:54.183502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49cbe113-f4aa-49fd-8320-5b87eac55b79 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:54.678621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Flavor limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:13:54.683329 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Image limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:13:54.685391 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Flavor pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:13:54.686264 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Image pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:13:54.689280 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:13:54.720267 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:54.721704 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:54.728875 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:54.731764 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:54.805830 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for project 93164c7b18524c7f9483aa0383349cb9. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:13:54.825934 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for user b1d770b6425649559463a5d37c3f3a3f and project 93164c7b18524c7f9483aa0383349cb9. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:13:54.849778 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-49cbe113-f4aa-49fd-8320-5b87eac55b79 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:54.860044 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-49cbe113-f4aa-49fd-8320-5b87eac55b79 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.711302 Jul 22 22:13:54.863902 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 20/41] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:54 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:54.883166 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Going to run 1 instances... {{(pid=107498) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:13:54.887994 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:13:55.019557 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2d44eab8-16ba-4cbf-a231-b5ea1a1317d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 4.470763 Jul 22 22:13:55.022929 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 22/42] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:13:50 2021] POST /compute/v2.1/servers => generated 404 bytes in 4480 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:13:55.040188 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5042e788-23f9-4dc6-a4aa-4b090ff224fa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:55.045938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5042e788-23f9-4dc6-a4aa-4b090ff224fa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:55.176744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6a12e9c5-20df-467f-bb4d-c8c9f1d07c85 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:55.177379 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6a12e9c5-20df-467f-bb4d-c8c9f1d07c85 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:55.195182 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6a12e9c5-20df-467f-bb4d-c8c9f1d07c85 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:55.196268 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6a12e9c5-20df-467f-bb4d-c8c9f1d07c85 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:55.199069 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6a12e9c5-20df-467f-bb4d-c8c9f1d07c85 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:55.199531 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6a12e9c5-20df-467f-bb4d-c8c9f1d07c85 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:55.412765 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5042e788-23f9-4dc6-a4aa-4b090ff224fa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:55.445371 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5042e788-23f9-4dc6-a4aa-4b090ff224fa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1242 microversion: 2.1 time: 0.415189 Jul 22 22:13:55.460552 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 21/43] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:55 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1242 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:13:55.874928 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6a12e9c5-20df-467f-bb4d-c8c9f1d07c85 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:55.894383 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7624f775-f7a1-45ef-b63d-d6590f985179 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:55.895527 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7624f775-f7a1-45ef-b63d-d6590f985179 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:55.897828 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6a12e9c5-20df-467f-bb4d-c8c9f1d07c85 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.726320 Jul 22 22:13:55.899107 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 23/44] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:55 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:55.924194 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7624f775-f7a1-45ef-b63d-d6590f985179 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:55.925229 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7624f775-f7a1-45ef-b63d-d6590f985179 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:55.927000 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7624f775-f7a1-45ef-b63d-d6590f985179 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:55.927976 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7624f775-f7a1-45ef-b63d-d6590f985179 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:56.222073 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7624f775-f7a1-45ef-b63d-d6590f985179 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:56.244803 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7624f775-f7a1-45ef-b63d-d6590f985179 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.360215 Jul 22 22:13:56.248756 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 22/45] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:55 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:56.470850 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3bbb391c-26f1-4444-a521-caa3d2f39af3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:56.471585 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3bbb391c-26f1-4444-a521-caa3d2f39af3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:56.480446 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3bbb391c-26f1-4444-a521-caa3d2f39af3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:56.481169 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3bbb391c-26f1-4444-a521-caa3d2f39af3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:56.482353 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3bbb391c-26f1-4444-a521-caa3d2f39af3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:56.483012 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3bbb391c-26f1-4444-a521-caa3d2f39af3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:56.563905 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3bbb391c-26f1-4444-a521-caa3d2f39af3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:56.581740 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3bbb391c-26f1-4444-a521-caa3d2f39af3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1294 microversion: 2.1 time: 0.114366 Jul 22 22:13:56.585507 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 24/46] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:56 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1294 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:56.677401 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1008599498", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6df68dab-9491-409a-9b1c-2c69807e5f2f"}], "security_groups": [{"name": "tempest-securitygroup--1150591228"}], "key_name": "tempest-keypair-2099399197", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:13:56.832260 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.network.neutron [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] validate_networks() for [('6df68dab-9491-409a-9b1c-2c69807e5f2f', None, None, None)] {{(pid=107499) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:13:56.914837 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-39d31b27-9efb-4c0b-af4e-84645e9fafc7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:56.916200 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-39d31b27-9efb-4c0b-af4e-84645e9fafc7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:56.923116 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39d31b27-9efb-4c0b-af4e-84645e9fafc7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:56.924037 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39d31b27-9efb-4c0b-af4e-84645e9fafc7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:56.925639 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39d31b27-9efb-4c0b-af4e-84645e9fafc7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:56.926325 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39d31b27-9efb-4c0b-af4e-84645e9fafc7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:57.573330 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-39d31b27-9efb-4c0b-af4e-84645e9fafc7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:57.577653 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Flavor limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:13:57.578097 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Image limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:13:57.579351 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Flavor pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:13:57.579851 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Image pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:13:57.580784 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:13:57.586414 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-39d31b27-9efb-4c0b-af4e-84645e9fafc7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.675632 Jul 22 22:13:57.596050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 25/47] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:56 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:57.596214 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:57.596214 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:57.596214 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:57.596214 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:57.596533 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fae6973f-70af-4a51-8363-cbfcb681be56 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:57.596533 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fae6973f-70af-4a51-8363-cbfcb681be56 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:57.612107 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fae6973f-70af-4a51-8363-cbfcb681be56 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:57.612613 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fae6973f-70af-4a51-8363-cbfcb681be56 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:57.613395 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fae6973f-70af-4a51-8363-cbfcb681be56 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:57.614090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fae6973f-70af-4a51-8363-cbfcb681be56 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:57.616539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:13:57.621430 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for user b12a8e4c8635473d9973af215bcbcc46 and project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:13:57.641945 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Going to run 1 instances... {{(pid=107499) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:13:57.645005 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107499) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:13:57.699654 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fab4be91-980a-4860-8b98-8b3789eb7b5a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 1.029321 Jul 22 22:13:57.705674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 23/48] 10.222.0.110 () {62 vars in 1193 bytes} [Thu Jul 22 22:13:56 2021] POST /compute/v2.1/servers => generated 404 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 22 22:13:57.705876 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ff2d76bb-0c4c-4f53-b22d-8e8682f56ec7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:57.706903 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ff2d76bb-0c4c-4f53-b22d-8e8682f56ec7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:57.714783 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff2d76bb-0c4c-4f53-b22d-8e8682f56ec7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:57.715304 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff2d76bb-0c4c-4f53-b22d-8e8682f56ec7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:57.716200 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff2d76bb-0c4c-4f53-b22d-8e8682f56ec7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:57.716922 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff2d76bb-0c4c-4f53-b22d-8e8682f56ec7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:57.822305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ff2d76bb-0c4c-4f53-b22d-8e8682f56ec7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:57.842795 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ff2d76bb-0c4c-4f53-b22d-8e8682f56ec7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1300 microversion: 2.1 time: 0.139232 Jul 22 22:13:57.843437 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 24/49] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:57 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:57.860564 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-01e96c53-9155-4594-8d8c-902e371a5f8e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:57.861601 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-01e96c53-9155-4594-8d8c-902e371a5f8e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:57.962257 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-01e96c53-9155-4594-8d8c-902e371a5f8e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:57.973761 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-01e96c53-9155-4594-8d8c-902e371a5f8e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:57.977942 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-01e96c53-9155-4594-8d8c-902e371a5f8e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:57.978781 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fae6973f-70af-4a51-8363-cbfcb681be56 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:57.980727 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-01e96c53-9155-4594-8d8c-902e371a5f8e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1286 microversion: 2.20 time: 0.135707 Jul 22 22:13:57.981541 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 25/50] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:13:57 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:13:57.993147 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fae6973f-70af-4a51-8363-cbfcb681be56 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.399160 Jul 22 22:13:57.993147 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 26/51] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:57 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:58.603145 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ee5a5af0-bc5c-47a9-804c-67410eb46418 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:58.604867 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ee5a5af0-bc5c-47a9-804c-67410eb46418 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:58.624714 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ee5a5af0-bc5c-47a9-804c-67410eb46418 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:58.625326 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ee5a5af0-bc5c-47a9-804c-67410eb46418 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:58.626167 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ee5a5af0-bc5c-47a9-804c-67410eb46418 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:58.632778 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ee5a5af0-bc5c-47a9-804c-67410eb46418 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:58.866715 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0c56602e-7950-4e5d-b351-18855f017c30 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:58.870324 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0c56602e-7950-4e5d-b351-18855f017c30 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:58.899716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0c56602e-7950-4e5d-b351-18855f017c30 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:58.915087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0c56602e-7950-4e5d-b351-18855f017c30 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:58.916629 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0c56602e-7950-4e5d-b351-18855f017c30 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:58.917718 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0c56602e-7950-4e5d-b351-18855f017c30 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:59.069025 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ee5a5af0-bc5c-47a9-804c-67410eb46418 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:59.085140 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ee5a5af0-bc5c-47a9-804c-67410eb46418 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.479160 Jul 22 22:13:59.086971 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 27/52] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:58 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:59.108091 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2928345c-57ba-4ee3-8eab-20ea8670bb09 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:59.108091 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2928345c-57ba-4ee3-8eab-20ea8670bb09 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:59.131026 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2928345c-57ba-4ee3-8eab-20ea8670bb09 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:59.131448 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2928345c-57ba-4ee3-8eab-20ea8670bb09 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:59.132249 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2928345c-57ba-4ee3-8eab-20ea8670bb09 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:59.133365 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2928345c-57ba-4ee3-8eab-20ea8670bb09 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:59.351675 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0c56602e-7950-4e5d-b351-18855f017c30 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:59.368225 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2928345c-57ba-4ee3-8eab-20ea8670bb09 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:59.369501 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0c56602e-7950-4e5d-b351-18855f017c30 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.510839 Jul 22 22:13:59.372871 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 26/53] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:58 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:13:59.378594 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-70e4d6ca-5ce9-41db-bb0d-53ac08c115d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:13:59.379919 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-70e4d6ca-5ce9-41db-bb0d-53ac08c115d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:13:59.384410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2928345c-57ba-4ee3-8eab-20ea8670bb09 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:59.386016 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2928345c-57ba-4ee3-8eab-20ea8670bb09 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:13:59.391977 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2928345c-57ba-4ee3-8eab-20ea8670bb09 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1338 microversion: 2.20 time: 0.298450 Jul 22 22:13:59.406878 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 28/54] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:13:59 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1338 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:13:59.412699 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70e4d6ca-5ce9-41db-bb0d-53ac08c115d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:59.413569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70e4d6ca-5ce9-41db-bb0d-53ac08c115d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:13:59.414642 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70e4d6ca-5ce9-41db-bb0d-53ac08c115d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:13:59.415680 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70e4d6ca-5ce9-41db-bb0d-53ac08c115d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:00.103850 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9d06fac0-8146-4e5b-ae13-b4c060df40de tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:00.105875 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9d06fac0-8146-4e5b-ae13-b4c060df40de tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:00.124626 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9d06fac0-8146-4e5b-ae13-b4c060df40de tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:00.126298 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9d06fac0-8146-4e5b-ae13-b4c060df40de tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:00.130818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9d06fac0-8146-4e5b-ae13-b4c060df40de tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:00.131658 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9d06fac0-8146-4e5b-ae13-b4c060df40de tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:00.239642 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-70e4d6ca-5ce9-41db-bb0d-53ac08c115d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:00.248543 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-70e4d6ca-5ce9-41db-bb0d-53ac08c115d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.874062 Jul 22 22:14:00.256828 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 27/55] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:13:59 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:00.387608 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-06cf1a12-cb95-4d99-89b1-9433529c62ee tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:00.388233 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-06cf1a12-cb95-4d99-89b1-9433529c62ee tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:00.397863 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-06cf1a12-cb95-4d99-89b1-9433529c62ee tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:00.406651 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-06cf1a12-cb95-4d99-89b1-9433529c62ee tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:00.407896 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-06cf1a12-cb95-4d99-89b1-9433529c62ee tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:00.408554 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-06cf1a12-cb95-4d99-89b1-9433529c62ee tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:00.827744 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-06cf1a12-cb95-4d99-89b1-9433529c62ee tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:00.839263 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-06cf1a12-cb95-4d99-89b1-9433529c62ee tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.455503 Jul 22 22:14:00.839866 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 28/56] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:00 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:00.855487 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-affb89df-fbd4-4ef3-96ac-7cc9dc2e1d6e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:00.856105 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-affb89df-fbd4-4ef3-96ac-7cc9dc2e1d6e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:00.877143 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-affb89df-fbd4-4ef3-96ac-7cc9dc2e1d6e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:00.877601 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-affb89df-fbd4-4ef3-96ac-7cc9dc2e1d6e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:00.878400 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-affb89df-fbd4-4ef3-96ac-7cc9dc2e1d6e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:00.878843 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-affb89df-fbd4-4ef3-96ac-7cc9dc2e1d6e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:00.980005 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9d06fac0-8146-4e5b-ae13-b4c060df40de tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:00.998735 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9d06fac0-8146-4e5b-ae13-b4c060df40de tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.899703 Jul 22 22:14:01.003245 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 29/57] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:00 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:01.018539 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-1d8025f4-67b0-4006-a58c-b8a81916b7f2 req-ae70eb24-6b16-489d-8bff-4c6f8a77fe23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c", "tag": "ca634450-7b4f-4ad9-a31e-a585086203cf"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:01.025019 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:14:01.025019 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:14:01.045437 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-1d8025f4-67b0-4006-a58c-b8a81916b7f2 req-ae70eb24-6b16-489d-8bff-4c6f8a77fe23 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:01.045965 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-1d8025f4-67b0-4006-a58c-b8a81916b7f2 req-ae70eb24-6b16-489d-8bff-4c6f8a77fe23 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:01.091841 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-affb89df-fbd4-4ef3-96ac-7cc9dc2e1d6e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:01.113436 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-affb89df-fbd4-4ef3-96ac-7cc9dc2e1d6e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:01.115130 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-affb89df-fbd4-4ef3-96ac-7cc9dc2e1d6e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:01.123780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-affb89df-fbd4-4ef3-96ac-7cc9dc2e1d6e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1344 microversion: 2.20 time: 0.272192 Jul 22 22:14:01.124384 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 29/58] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:00 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1344 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:01.146693 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-1d8025f4-67b0-4006-a58c-b8a81916b7f2 req-ae70eb24-6b16-489d-8bff-4c6f8a77fe23 service nova] Creating event network-changed:ca634450-7b4f-4ad9-a31e-a585086203cf for instance 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c on hv-cinder-80186 Jul 22 22:14:01.147406 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-1d8025f4-67b0-4006-a58c-b8a81916b7f2 req-ae70eb24-6b16-489d-8bff-4c6f8a77fe23 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107498) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 22 22:14:01.153711 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c7f3d3e6-82f8-4125-b17b-a71973ca1bc0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:01.154463 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c7f3d3e6-82f8-4125-b17b-a71973ca1bc0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:01.155781 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c7f3d3e6-82f8-4125-b17b-a71973ca1bc0 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:01.156334 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c7f3d3e6-82f8-4125-b17b-a71973ca1bc0 None None] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:01.187165 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.compute.rpcapi [None req-c7f3d3e6-82f8-4125-b17b-a71973ca1bc0 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 22 22:14:01.189610 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c7f3d3e6-82f8-4125-b17b-a71973ca1bc0 None None] Releasing lock "compute-rpcapi-router" {{(pid=107498) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 22 22:14:01.235373 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c7f3d3e6-82f8-4125-b17b-a71973ca1bc0 None None] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229810 Jul 22 22:14:01.237569 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 30/59] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:14:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:14:01.282320 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-12e68a3a-d723-48f4-b1ea-259008e27f7d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:01.283687 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-12e68a3a-d723-48f4-b1ea-259008e27f7d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:01.295271 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-12e68a3a-d723-48f4-b1ea-259008e27f7d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:01.297796 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-12e68a3a-d723-48f4-b1ea-259008e27f7d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:01.298964 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-12e68a3a-d723-48f4-b1ea-259008e27f7d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:01.300739 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-12e68a3a-d723-48f4-b1ea-259008e27f7d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:01.649203 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-12e68a3a-d723-48f4-b1ea-259008e27f7d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:01.659427 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-12e68a3a-d723-48f4-b1ea-259008e27f7d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.380003 Jul 22 22:14:01.661112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 30/60] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:01 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:01.858973 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d87fc9e1-c592-45c7-965b-cd2ca3141b5e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:01.859774 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d87fc9e1-c592-45c7-965b-cd2ca3141b5e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:01.870967 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d87fc9e1-c592-45c7-965b-cd2ca3141b5e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:01.871429 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d87fc9e1-c592-45c7-965b-cd2ca3141b5e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:01.872239 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d87fc9e1-c592-45c7-965b-cd2ca3141b5e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:01.872709 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d87fc9e1-c592-45c7-965b-cd2ca3141b5e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:02.039061 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-63774f59-cca5-494b-bc00-092b9c466fd7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:02.040021 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-63774f59-cca5-494b-bc00-092b9c466fd7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:02.051895 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-63774f59-cca5-494b-bc00-092b9c466fd7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:02.056385 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-63774f59-cca5-494b-bc00-092b9c466fd7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:02.059674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-63774f59-cca5-494b-bc00-092b9c466fd7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:02.062196 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-63774f59-cca5-494b-bc00-092b9c466fd7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:02.397258 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d87fc9e1-c592-45c7-965b-cd2ca3141b5e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:02.407834 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d87fc9e1-c592-45c7-965b-cd2ca3141b5e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.553241 Jul 22 22:14:02.417424 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 31/61] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:01 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:02.417424 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-51e1d212-2133-4d8b-972b-fd13dbd6f8a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:02.417424 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-51e1d212-2133-4d8b-972b-fd13dbd6f8a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:02.424469 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51e1d212-2133-4d8b-972b-fd13dbd6f8a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:02.425078 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51e1d212-2133-4d8b-972b-fd13dbd6f8a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:02.426452 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51e1d212-2133-4d8b-972b-fd13dbd6f8a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:02.428184 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51e1d212-2133-4d8b-972b-fd13dbd6f8a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:02.598222 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-63774f59-cca5-494b-bc00-092b9c466fd7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:02.610602 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-63774f59-cca5-494b-bc00-092b9c466fd7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.574492 Jul 22 22:14:02.622122 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 31/62] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:02 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:02.679625 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b8819ce5-cb17-4a9d-a8ba-fa037a314997 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:02.680486 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b8819ce5-cb17-4a9d-a8ba-fa037a314997 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:02.687676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8819ce5-cb17-4a9d-a8ba-fa037a314997 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:02.690742 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8819ce5-cb17-4a9d-a8ba-fa037a314997 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:02.691549 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8819ce5-cb17-4a9d-a8ba-fa037a314997 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:02.692104 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8819ce5-cb17-4a9d-a8ba-fa037a314997 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:02.841343 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-51e1d212-2133-4d8b-972b-fd13dbd6f8a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:02.856880 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-51e1d212-2133-4d8b-972b-fd13dbd6f8a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:02.860881 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-51e1d212-2133-4d8b-972b-fd13dbd6f8a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:02.862032 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-51e1d212-2133-4d8b-972b-fd13dbd6f8a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.452328 Jul 22 22:14:02.865146 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 32/63] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:02 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:03.143053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-5267fadc-cf1b-4d03-9e3c-9c41e4e9a50f req-e91642f7-8c63-4a58-a160-8f5f4aed0cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6bddb6-47da-429e-9c5d-d9e1d50b4245", "name": "network-vif-plugged", "status": "completed", "tag": "30112f59-0c99-4523-9a13-983baff94680"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:03.144674 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:14:03.144674 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:14:03.160181 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-5267fadc-cf1b-4d03-9e3c-9c41e4e9a50f req-e91642f7-8c63-4a58-a160-8f5f4aed0cac service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:03.161053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-5267fadc-cf1b-4d03-9e3c-9c41e4e9a50f req-e91642f7-8c63-4a58-a160-8f5f4aed0cac service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:03.179820 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b8819ce5-cb17-4a9d-a8ba-fa037a314997 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:03.183656 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-5267fadc-cf1b-4d03-9e3c-9c41e4e9a50f req-e91642f7-8c63-4a58-a160-8f5f4aed0cac service nova] Creating event network-vif-plugged:30112f59-0c99-4523-9a13-983baff94680 for instance 4d6bddb6-47da-429e-9c5d-d9e1d50b4245 on hv-cinder-80186 Jul 22 22:14:03.188374 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b8819ce5-cb17-4a9d-a8ba-fa037a314997 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.512893 Jul 22 22:14:03.189007 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 32/64] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:02 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:03.202443 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-5267fadc-cf1b-4d03-9e3c-9c41e4e9a50f req-e91642f7-8c63-4a58-a160-8f5f4aed0cac service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152273 Jul 22 22:14:03.203713 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 33/65] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:14:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:14:03.402776 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-0499b46a-740f-4808-bfac-83c148a6a4d5 req-d63e27ef-912e-4934-9333-49106eecebf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61e7dd91-3f55-48c9-85aa-84c2450719f2", "tag": "e63aa00d-561e-478c-ad51-2858e1d33423"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:03.412747 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:14:03.412747 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:14:03.425438 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-0499b46a-740f-4808-bfac-83c148a6a4d5 req-d63e27ef-912e-4934-9333-49106eecebf1 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:03.426238 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5e6d7399-2326-4c0e-8677-44315ea8ec92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:03.426729 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-0499b46a-740f-4808-bfac-83c148a6a4d5 req-d63e27ef-912e-4934-9333-49106eecebf1 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:03.427829 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5e6d7399-2326-4c0e-8677-44315ea8ec92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:03.448399 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5e6d7399-2326-4c0e-8677-44315ea8ec92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:03.448882 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5e6d7399-2326-4c0e-8677-44315ea8ec92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:03.449730 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5e6d7399-2326-4c0e-8677-44315ea8ec92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:03.450168 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5e6d7399-2326-4c0e-8677-44315ea8ec92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:03.471101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-0499b46a-740f-4808-bfac-83c148a6a4d5 req-d63e27ef-912e-4934-9333-49106eecebf1 service nova] Creating event network-changed:e63aa00d-561e-478c-ad51-2858e1d33423 for instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 on hv-cinder-80186 Jul 22 22:14:03.486138 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-0499b46a-740f-4808-bfac-83c148a6a4d5 req-d63e27ef-912e-4934-9333-49106eecebf1 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089375 Jul 22 22:14:03.488816 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 33/66] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:14:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:14:03.629634 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-68ad17c3-70ab-41b4-a71a-4b5fff565d9d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:03.630332 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-68ad17c3-70ab-41b4-a71a-4b5fff565d9d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:03.638534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-68ad17c3-70ab-41b4-a71a-4b5fff565d9d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:03.643827 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-68ad17c3-70ab-41b4-a71a-4b5fff565d9d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:03.648798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-68ad17c3-70ab-41b4-a71a-4b5fff565d9d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:03.649696 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-68ad17c3-70ab-41b4-a71a-4b5fff565d9d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:03.857730 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5e6d7399-2326-4c0e-8677-44315ea8ec92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:03.874354 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5e6d7399-2326-4c0e-8677-44315ea8ec92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.450809 Jul 22 22:14:03.876794 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 34/67] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:03 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:03.886297 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d70549b8-7002-4055-921e-a066b79105de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:03.887880 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d70549b8-7002-4055-921e-a066b79105de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:03.898139 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d70549b8-7002-4055-921e-a066b79105de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:03.898590 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d70549b8-7002-4055-921e-a066b79105de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:03.902156 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d70549b8-7002-4055-921e-a066b79105de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:03.902621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d70549b8-7002-4055-921e-a066b79105de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:04.003523 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-68ad17c3-70ab-41b4-a71a-4b5fff565d9d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:04.028162 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-68ad17c3-70ab-41b4-a71a-4b5fff565d9d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.403001 Jul 22 22:14:04.028976 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 34/68] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:03 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:04.207716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0a92258d-784e-449b-8bef-f1e9f0e2d690 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:04.208352 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0a92258d-784e-449b-8bef-f1e9f0e2d690 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:04.209261 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d70549b8-7002-4055-921e-a066b79105de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:04.218179 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0a92258d-784e-449b-8bef-f1e9f0e2d690 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:04.218742 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0a92258d-784e-449b-8bef-f1e9f0e2d690 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:04.219747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d70549b8-7002-4055-921e-a066b79105de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:04.219913 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0a92258d-784e-449b-8bef-f1e9f0e2d690 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:04.220450 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0a92258d-784e-449b-8bef-f1e9f0e2d690 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:04.221607 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d70549b8-7002-4055-921e-a066b79105de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:04.223826 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d70549b8-7002-4055-921e-a066b79105de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.342280 Jul 22 22:14:04.224895 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 35/69] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:03 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:14:04.382101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0a92258d-784e-449b-8bef-f1e9f0e2d690 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:04.391452 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0a92258d-784e-449b-8bef-f1e9f0e2d690 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.188107 Jul 22 22:14:04.392243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 35/70] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:04 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:04.893215 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cf53aa58-a4f9-49d0-8b04-b117c4dd68d5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:04.894332 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cf53aa58-a4f9-49d0-8b04-b117c4dd68d5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:04.903706 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cf53aa58-a4f9-49d0-8b04-b117c4dd68d5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:04.904662 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cf53aa58-a4f9-49d0-8b04-b117c4dd68d5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:04.905356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cf53aa58-a4f9-49d0-8b04-b117c4dd68d5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:04.908935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cf53aa58-a4f9-49d0-8b04-b117c4dd68d5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:05.045400 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d8cbd175-6ba7-46d7-a588-2511f8c6eff1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:05.046142 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d8cbd175-6ba7-46d7-a588-2511f8c6eff1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:05.062280 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d8cbd175-6ba7-46d7-a588-2511f8c6eff1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:05.064992 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d8cbd175-6ba7-46d7-a588-2511f8c6eff1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:05.066467 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d8cbd175-6ba7-46d7-a588-2511f8c6eff1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:05.066921 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d8cbd175-6ba7-46d7-a588-2511f8c6eff1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:05.099958 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cf53aa58-a4f9-49d0-8b04-b117c4dd68d5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:05.111775 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cf53aa58-a4f9-49d0-8b04-b117c4dd68d5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.222975 Jul 22 22:14:05.112377 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 36/71] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:04 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:05.249325 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-214e3c8a-5c57-40dd-990a-f31aca88dde0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:05.254158 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-214e3c8a-5c57-40dd-990a-f31aca88dde0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:05.266121 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-214e3c8a-5c57-40dd-990a-f31aca88dde0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:05.267306 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-214e3c8a-5c57-40dd-990a-f31aca88dde0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:05.268137 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-214e3c8a-5c57-40dd-990a-f31aca88dde0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:05.268722 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-214e3c8a-5c57-40dd-990a-f31aca88dde0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:05.303016 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d8cbd175-6ba7-46d7-a588-2511f8c6eff1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:05.318601 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d8cbd175-6ba7-46d7-a588-2511f8c6eff1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.275369 Jul 22 22:14:05.329072 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 36/72] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:05 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:05.337243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-502f4acb-f9e3-46e3-a4b9-20b5e2e944f6 req-6eaa0341-42d4-4663-a468-3c6beccdc74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73570a19-27c7-4bdc-b64c-a0c5e008ff3f", "name": "network-vif-plugged", "status": "completed", "tag": "8c0d6a5f-9b31-4e52-a742-c404c46232c7"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:05.343975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:14:05.343975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:14:05.354708 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-502f4acb-f9e3-46e3-a4b9-20b5e2e944f6 req-6eaa0341-42d4-4663-a468-3c6beccdc74d service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:05.355327 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-502f4acb-f9e3-46e3-a4b9-20b5e2e944f6 req-6eaa0341-42d4-4663-a468-3c6beccdc74d service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:05.374162 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-502f4acb-f9e3-46e3-a4b9-20b5e2e944f6 req-6eaa0341-42d4-4663-a468-3c6beccdc74d service nova] Creating event network-vif-plugged:8c0d6a5f-9b31-4e52-a742-c404c46232c7 for instance 73570a19-27c7-4bdc-b64c-a0c5e008ff3f on hv-cinder-80186 Jul 22 22:14:05.384257 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-502f4acb-f9e3-46e3-a4b9-20b5e2e944f6 req-6eaa0341-42d4-4663-a468-3c6beccdc74d service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053591 Jul 22 22:14:05.385602 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 37/73] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:14:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:14:05.410586 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fbefd34f-cdd9-4c83-b9c4-21bec9df78ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:05.412393 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fbefd34f-cdd9-4c83-b9c4-21bec9df78ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:05.419147 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbefd34f-cdd9-4c83-b9c4-21bec9df78ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:05.419972 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbefd34f-cdd9-4c83-b9c4-21bec9df78ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:05.420910 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbefd34f-cdd9-4c83-b9c4-21bec9df78ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:05.421612 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbefd34f-cdd9-4c83-b9c4-21bec9df78ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:05.453997 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-214e3c8a-5c57-40dd-990a-f31aca88dde0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:05.464606 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-214e3c8a-5c57-40dd-990a-f31aca88dde0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:05.467604 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-214e3c8a-5c57-40dd-990a-f31aca88dde0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:05.469354 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-214e3c8a-5c57-40dd-990a-f31aca88dde0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.227844 Jul 22 22:14:05.470529 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 37/74] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:05 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:14:05.633306 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fbefd34f-cdd9-4c83-b9c4-21bec9df78ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:05.651596 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fbefd34f-cdd9-4c83-b9c4-21bec9df78ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.239284 Jul 22 22:14:05.652390 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 38/75] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:05 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:06.129267 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5a752110-d535-416a-9431-8e39f1a5adae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:06.129941 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5a752110-d535-416a-9431-8e39f1a5adae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:06.136371 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5a752110-d535-416a-9431-8e39f1a5adae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:06.136822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5a752110-d535-416a-9431-8e39f1a5adae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:06.137596 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5a752110-d535-416a-9431-8e39f1a5adae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:06.138221 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5a752110-d535-416a-9431-8e39f1a5adae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:06.335410 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-86deff62-331a-4bd3-9227-607397cd8da9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:06.336021 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-86deff62-331a-4bd3-9227-607397cd8da9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:06.342665 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-86deff62-331a-4bd3-9227-607397cd8da9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:06.343274 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-86deff62-331a-4bd3-9227-607397cd8da9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:06.344480 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-86deff62-331a-4bd3-9227-607397cd8da9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:06.345093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-86deff62-331a-4bd3-9227-607397cd8da9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:06.509677 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5a752110-d535-416a-9431-8e39f1a5adae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:06.515097 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-86deff62-331a-4bd3-9227-607397cd8da9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:06.519048 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5a752110-d535-416a-9431-8e39f1a5adae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.393258 Jul 22 22:14:06.520255 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 38/76] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:06 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:06.522429 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-86deff62-331a-4bd3-9227-607397cd8da9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.191272 Jul 22 22:14:06.527929 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 39/77] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:06 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:06.533356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a02c4af5-bfe8-44c6-a398-e4abcce7849d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:06.534086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a02c4af5-bfe8-44c6-a398-e4abcce7849d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:06.540550 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a02c4af5-bfe8-44c6-a398-e4abcce7849d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:06.541060 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a02c4af5-bfe8-44c6-a398-e4abcce7849d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:06.542053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a02c4af5-bfe8-44c6-a398-e4abcce7849d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:06.542328 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a02c4af5-bfe8-44c6-a398-e4abcce7849d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:06.669494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c70570ad-b934-4a4e-9d56-1e0c36b6e043 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:06.670121 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c70570ad-b934-4a4e-9d56-1e0c36b6e043 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:06.678489 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c70570ad-b934-4a4e-9d56-1e0c36b6e043 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:06.679156 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c70570ad-b934-4a4e-9d56-1e0c36b6e043 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:06.680088 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c70570ad-b934-4a4e-9d56-1e0c36b6e043 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:06.682081 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c70570ad-b934-4a4e-9d56-1e0c36b6e043 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:06.756857 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a02c4af5-bfe8-44c6-a398-e4abcce7849d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:06.767438 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a02c4af5-bfe8-44c6-a398-e4abcce7849d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:06.769108 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a02c4af5-bfe8-44c6-a398-e4abcce7849d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:06.772311 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a02c4af5-bfe8-44c6-a398-e4abcce7849d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.248873 Jul 22 22:14:06.772311 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 39/78] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:06 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:06.914143 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c70570ad-b934-4a4e-9d56-1e0c36b6e043 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:06.923562 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c70570ad-b934-4a4e-9d56-1e0c36b6e043 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.257658 Jul 22 22:14:06.933612 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 40/79] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:06 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:07.538983 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-60827f3b-b8bc-43eb-ab88-e302e16e6da3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:07.539606 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9cb3b4e9-0c30-43b7-88a9-7a49499c10ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:07.539952 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9cb3b4e9-0c30-43b7-88a9-7a49499c10ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:07.540845 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-60827f3b-b8bc-43eb-ab88-e302e16e6da3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:07.545888 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9cb3b4e9-0c30-43b7-88a9-7a49499c10ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:07.546352 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9cb3b4e9-0c30-43b7-88a9-7a49499c10ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:07.547882 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9cb3b4e9-0c30-43b7-88a9-7a49499c10ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:07.548779 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9cb3b4e9-0c30-43b7-88a9-7a49499c10ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:07.549185 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-60827f3b-b8bc-43eb-ab88-e302e16e6da3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:07.549792 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-60827f3b-b8bc-43eb-ab88-e302e16e6da3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:07.550923 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-60827f3b-b8bc-43eb-ab88-e302e16e6da3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:07.551508 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-60827f3b-b8bc-43eb-ab88-e302e16e6da3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:07.721293 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9cb3b4e9-0c30-43b7-88a9-7a49499c10ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:07.729842 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-60827f3b-b8bc-43eb-ab88-e302e16e6da3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:07.730043 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9cb3b4e9-0c30-43b7-88a9-7a49499c10ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.194469 Jul 22 22:14:07.740497 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 40/80] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:07 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:07.747952 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-60827f3b-b8bc-43eb-ab88-e302e16e6da3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.212507 Jul 22 22:14:07.748741 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 41/81] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:07 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:07.791894 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-61ab754c-089e-48f4-b6ef-82d467048624 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:07.793099 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-61ab754c-089e-48f4-b6ef-82d467048624 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:07.801447 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-61ab754c-089e-48f4-b6ef-82d467048624 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:07.802164 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-61ab754c-089e-48f4-b6ef-82d467048624 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:07.803726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-61ab754c-089e-48f4-b6ef-82d467048624 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:07.804644 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-61ab754c-089e-48f4-b6ef-82d467048624 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:07.940809 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5efaa328-e29f-47eb-b2f2-59c2a8832796 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:07.941429 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5efaa328-e29f-47eb-b2f2-59c2a8832796 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:07.947569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5efaa328-e29f-47eb-b2f2-59c2a8832796 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:07.948021 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5efaa328-e29f-47eb-b2f2-59c2a8832796 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:07.948912 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5efaa328-e29f-47eb-b2f2-59c2a8832796 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:07.949253 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5efaa328-e29f-47eb-b2f2-59c2a8832796 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:07.972616 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-61ab754c-089e-48f4-b6ef-82d467048624 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:07.986399 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-61ab754c-089e-48f4-b6ef-82d467048624 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:07.988031 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-61ab754c-089e-48f4-b6ef-82d467048624 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:07.990349 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-61ab754c-089e-48f4-b6ef-82d467048624 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.204376 Jul 22 22:14:07.998077 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 41/82] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:07 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:08.417222 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5efaa328-e29f-47eb-b2f2-59c2a8832796 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:08.444326 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5efaa328-e29f-47eb-b2f2-59c2a8832796 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.507497 Jul 22 22:14:08.446355 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 42/83] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:07 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:08.746908 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ee3c110c-d6ee-4c7d-b6aa-6b89e43fe424 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:08.748436 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ee3c110c-d6ee-4c7d-b6aa-6b89e43fe424 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:08.757709 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ee3c110c-d6ee-4c7d-b6aa-6b89e43fe424 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:08.758320 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ee3c110c-d6ee-4c7d-b6aa-6b89e43fe424 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:08.759241 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ee3c110c-d6ee-4c7d-b6aa-6b89e43fe424 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:08.759875 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ee3c110c-d6ee-4c7d-b6aa-6b89e43fe424 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:08.767962 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-79deed92-f4d4-434e-b727-638dc46b49a4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:08.768769 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-79deed92-f4d4-434e-b727-638dc46b49a4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:08.778149 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79deed92-f4d4-434e-b727-638dc46b49a4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:08.779281 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79deed92-f4d4-434e-b727-638dc46b49a4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:08.780913 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79deed92-f4d4-434e-b727-638dc46b49a4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:08.783166 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79deed92-f4d4-434e-b727-638dc46b49a4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:08.916580 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ee3c110c-d6ee-4c7d-b6aa-6b89e43fe424 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:08.925756 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ee3c110c-d6ee-4c7d-b6aa-6b89e43fe424 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.182342 Jul 22 22:14:08.926339 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 42/84] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:08 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:08.938837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-79deed92-f4d4-434e-b727-638dc46b49a4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:08.946485 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-79deed92-f4d4-434e-b727-638dc46b49a4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.184969 Jul 22 22:14:08.947050 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 43/85] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:08 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:09.010336 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6f1ef914-0293-46b5-9436-0640e6b93d93 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:09.010937 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6f1ef914-0293-46b5-9436-0640e6b93d93 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:09.016802 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6f1ef914-0293-46b5-9436-0640e6b93d93 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:09.017238 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6f1ef914-0293-46b5-9436-0640e6b93d93 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:09.017990 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6f1ef914-0293-46b5-9436-0640e6b93d93 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:09.018415 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6f1ef914-0293-46b5-9436-0640e6b93d93 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:09.277543 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6f1ef914-0293-46b5-9436-0640e6b93d93 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:09.286782 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6f1ef914-0293-46b5-9436-0640e6b93d93 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:09.288399 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6f1ef914-0293-46b5-9436-0640e6b93d93 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:09.289489 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6f1ef914-0293-46b5-9436-0640e6b93d93 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.282970 Jul 22 22:14:09.290036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 43/86] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:09 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:09.464111 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a603fa69-7993-4904-b763-ed8331c6e5d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:09.464798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a603fa69-7993-4904-b763-ed8331c6e5d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:09.471826 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a603fa69-7993-4904-b763-ed8331c6e5d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:09.472418 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a603fa69-7993-4904-b763-ed8331c6e5d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:09.473326 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a603fa69-7993-4904-b763-ed8331c6e5d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:09.473832 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a603fa69-7993-4904-b763-ed8331c6e5d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:09.618708 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a603fa69-7993-4904-b763-ed8331c6e5d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:09.627056 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a603fa69-7993-4904-b763-ed8331c6e5d8 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.166910 Jul 22 22:14:09.636357 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 44/87] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:09 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:09.873333 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-4c716752-b7f9-421d-8335-46724f2ec2f4 req-81cc0d74-6be1-4ddb-a257-c58bd660fd87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c", "name": "network-vif-plugged", "status": "completed", "tag": "ca634450-7b4f-4ad9-a31e-a585086203cf"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:09.877017 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:14:09.877017 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:14:09.902760 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-4c716752-b7f9-421d-8335-46724f2ec2f4 req-81cc0d74-6be1-4ddb-a257-c58bd660fd87 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:09.905088 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-4c716752-b7f9-421d-8335-46724f2ec2f4 req-81cc0d74-6be1-4ddb-a257-c58bd660fd87 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:09.937149 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-4c716752-b7f9-421d-8335-46724f2ec2f4 req-81cc0d74-6be1-4ddb-a257-c58bd660fd87 service nova] Creating event network-vif-plugged:ca634450-7b4f-4ad9-a31e-a585086203cf for instance 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c on hv-cinder-80186 Jul 22 22:14:09.946228 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b73be5bd-21f6-4ccd-b083-465331f1f7b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:09.947939 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b73be5bd-21f6-4ccd-b083-465331f1f7b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:09.951396 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-4c716752-b7f9-421d-8335-46724f2ec2f4 req-81cc0d74-6be1-4ddb-a257-c58bd660fd87 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078357 Jul 22 22:14:09.952515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 44/88] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:14:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:14:09.966500 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9e0c062d-722c-4bf0-af67-f43afa390d52 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:09.967450 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9e0c062d-722c-4bf0-af67-f43afa390d52 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:09.968312 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b73be5bd-21f6-4ccd-b083-465331f1f7b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:09.969463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b73be5bd-21f6-4ccd-b083-465331f1f7b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:09.970466 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b73be5bd-21f6-4ccd-b083-465331f1f7b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:09.970802 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b73be5bd-21f6-4ccd-b083-465331f1f7b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:09.991928 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9e0c062d-722c-4bf0-af67-f43afa390d52 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:09.992424 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9e0c062d-722c-4bf0-af67-f43afa390d52 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:09.995096 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9e0c062d-722c-4bf0-af67-f43afa390d52 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:09.995096 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9e0c062d-722c-4bf0-af67-f43afa390d52 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:10.211622 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b73be5bd-21f6-4ccd-b083-465331f1f7b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:10.217927 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9e0c062d-722c-4bf0-af67-f43afa390d52 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:10.219393 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b73be5bd-21f6-4ccd-b083-465331f1f7b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.278017 Jul 22 22:14:10.220188 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 45/89] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:09 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:10.233713 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9e0c062d-722c-4bf0-af67-f43afa390d52 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.273094 Jul 22 22:14:10.234327 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 45/90] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:09 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:10.309364 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6d003fad-4fe3-40ac-8a8d-66081fab36e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:10.311111 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6d003fad-4fe3-40ac-8a8d-66081fab36e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:10.318638 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6d003fad-4fe3-40ac-8a8d-66081fab36e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:10.319074 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6d003fad-4fe3-40ac-8a8d-66081fab36e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:10.320086 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6d003fad-4fe3-40ac-8a8d-66081fab36e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:10.320721 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6d003fad-4fe3-40ac-8a8d-66081fab36e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:10.465862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6d003fad-4fe3-40ac-8a8d-66081fab36e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:10.473720 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6d003fad-4fe3-40ac-8a8d-66081fab36e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:10.475318 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6d003fad-4fe3-40ac-8a8d-66081fab36e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:10.476443 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6d003fad-4fe3-40ac-8a8d-66081fab36e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.170962 Jul 22 22:14:10.476975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 46/91] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:10 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:10.643507 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-dc840c4f-8d00-4974-ad63-5e440d6ee40e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:10.644123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-dc840c4f-8d00-4974-ad63-5e440d6ee40e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:10.650169 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dc840c4f-8d00-4974-ad63-5e440d6ee40e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:10.650622 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dc840c4f-8d00-4974-ad63-5e440d6ee40e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:10.651419 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dc840c4f-8d00-4974-ad63-5e440d6ee40e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:10.651849 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dc840c4f-8d00-4974-ad63-5e440d6ee40e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:10.785956 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-dc840c4f-8d00-4974-ad63-5e440d6ee40e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:10.793476 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-dc840c4f-8d00-4974-ad63-5e440d6ee40e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1319 microversion: 2.1 time: 0.154062 Jul 22 22:14:10.794038 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 46/92] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:10 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:11.237233 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3c5a0820-1959-4525-9c92-4ccdf5a45939 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:11.238343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3c5a0820-1959-4525-9c92-4ccdf5a45939 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:11.246695 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3c5a0820-1959-4525-9c92-4ccdf5a45939 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:11.247409 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3c5a0820-1959-4525-9c92-4ccdf5a45939 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:11.248419 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3c5a0820-1959-4525-9c92-4ccdf5a45939 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:11.249006 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3c5a0820-1959-4525-9c92-4ccdf5a45939 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:11.250305 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-84585cbe-de7b-43ea-b041-a9a74d2bd4dc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:11.252346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-84585cbe-de7b-43ea-b041-a9a74d2bd4dc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:11.259662 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-84585cbe-de7b-43ea-b041-a9a74d2bd4dc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:11.260114 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-84585cbe-de7b-43ea-b041-a9a74d2bd4dc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:11.260925 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-84585cbe-de7b-43ea-b041-a9a74d2bd4dc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:11.261361 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-84585cbe-de7b-43ea-b041-a9a74d2bd4dc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:11.422784 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3c5a0820-1959-4525-9c92-4ccdf5a45939 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:11.434063 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3c5a0820-1959-4525-9c92-4ccdf5a45939 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.200733 Jul 22 22:14:11.434882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 47/93] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:11 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:11.474540 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-84585cbe-de7b-43ea-b041-a9a74d2bd4dc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:11.487982 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-84585cbe-de7b-43ea-b041-a9a74d2bd4dc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1322 microversion: 2.1 time: 0.241290 Jul 22 22:14:11.488705 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 47/94] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:11 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:11.497933 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c624985a-26d3-4cec-a5c4-3d482ad6b119 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:11.497933 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c624985a-26d3-4cec-a5c4-3d482ad6b119 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:11.508794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c624985a-26d3-4cec-a5c4-3d482ad6b119 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:11.508794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c624985a-26d3-4cec-a5c4-3d482ad6b119 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:11.508794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c624985a-26d3-4cec-a5c4-3d482ad6b119 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:11.508794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c624985a-26d3-4cec-a5c4-3d482ad6b119 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:11.691151 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c624985a-26d3-4cec-a5c4-3d482ad6b119 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:11.700819 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c624985a-26d3-4cec-a5c4-3d482ad6b119 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:11.702130 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c624985a-26d3-4cec-a5c4-3d482ad6b119 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:11.703235 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c624985a-26d3-4cec-a5c4-3d482ad6b119 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.212298 Jul 22 22:14:11.703792 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 48/95] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:11 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:14:11.810885 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e7b94508-93bc-478e-958c-404907bc7596 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:11.811466 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e7b94508-93bc-478e-958c-404907bc7596 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:11.818287 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e7b94508-93bc-478e-958c-404907bc7596 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:11.818744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e7b94508-93bc-478e-958c-404907bc7596 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:11.819511 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e7b94508-93bc-478e-958c-404907bc7596 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:11.819938 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e7b94508-93bc-478e-958c-404907bc7596 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:11.992519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e7b94508-93bc-478e-958c-404907bc7596 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:11.996010 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e7b94508-93bc-478e-958c-404907bc7596 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1505 microversion: 2.1 time: 0.189067 Jul 22 22:14:11.996629 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 48/96] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:11 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:12.452178 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-94d367fb-9841-4813-b3c3-f1099399aafd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:12.452830 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-94d367fb-9841-4813-b3c3-f1099399aafd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:12.458908 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94d367fb-9841-4813-b3c3-f1099399aafd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:12.459356 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94d367fb-9841-4813-b3c3-f1099399aafd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:12.460128 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94d367fb-9841-4813-b3c3-f1099399aafd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:12.460663 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94d367fb-9841-4813-b3c3-f1099399aafd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:12.505842 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6b79d1c9-7db4-49c6-b555-6d7ebf424f0a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:12.506461 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6b79d1c9-7db4-49c6-b555-6d7ebf424f0a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:12.512640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6b79d1c9-7db4-49c6-b555-6d7ebf424f0a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:12.513096 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6b79d1c9-7db4-49c6-b555-6d7ebf424f0a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:12.513874 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6b79d1c9-7db4-49c6-b555-6d7ebf424f0a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:12.514407 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6b79d1c9-7db4-49c6-b555-6d7ebf424f0a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:12.613383 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-94d367fb-9841-4813-b3c3-f1099399aafd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:12.622518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-94d367fb-9841-4813-b3c3-f1099399aafd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.173844 Jul 22 22:14:12.623089 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 49/97] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:12 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:12.662181 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6b79d1c9-7db4-49c6-b555-6d7ebf424f0a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:12.669652 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6b79d1c9-7db4-49c6-b555-6d7ebf424f0a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1511 microversion: 2.1 time: 0.168319 Jul 22 22:14:12.670216 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 49/98] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:12 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:12.721292 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9a011661-2ba3-4f19-918e-ee5dd37aaeec tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:12.721912 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9a011661-2ba3-4f19-918e-ee5dd37aaeec tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:12.728156 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9a011661-2ba3-4f19-918e-ee5dd37aaeec tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:12.728632 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9a011661-2ba3-4f19-918e-ee5dd37aaeec tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:12.732222 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9a011661-2ba3-4f19-918e-ee5dd37aaeec tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:12.732697 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9a011661-2ba3-4f19-918e-ee5dd37aaeec tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:12.885917 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9a011661-2ba3-4f19-918e-ee5dd37aaeec tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:12.894304 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9a011661-2ba3-4f19-918e-ee5dd37aaeec tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:12.896085 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9a011661-2ba3-4f19-918e-ee5dd37aaeec tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:12.897466 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9a011661-2ba3-4f19-918e-ee5dd37aaeec tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.180601 Jul 22 22:14:12.898379 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 50/99] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:12 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:13.640641 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-686f13bc-16dc-4c47-8e7c-cbccd28d6d52 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:13.641247 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-686f13bc-16dc-4c47-8e7c-cbccd28d6d52 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:13.648416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-686f13bc-16dc-4c47-8e7c-cbccd28d6d52 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:13.648870 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-686f13bc-16dc-4c47-8e7c-cbccd28d6d52 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:13.649638 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-686f13bc-16dc-4c47-8e7c-cbccd28d6d52 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:13.650069 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-686f13bc-16dc-4c47-8e7c-cbccd28d6d52 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:13.817797 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-686f13bc-16dc-4c47-8e7c-cbccd28d6d52 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:13.825133 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-686f13bc-16dc-4c47-8e7c-cbccd28d6d52 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.188207 Jul 22 22:14:13.825879 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 50/100] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:13 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:13.915264 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6da0653f-e7a5-4b69-bc9b-4d4c46098a6f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:13.915862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6da0653f-e7a5-4b69-bc9b-4d4c46098a6f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:13.921591 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6da0653f-e7a5-4b69-bc9b-4d4c46098a6f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:13.922029 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6da0653f-e7a5-4b69-bc9b-4d4c46098a6f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:13.922843 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6da0653f-e7a5-4b69-bc9b-4d4c46098a6f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:13.923921 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6da0653f-e7a5-4b69-bc9b-4d4c46098a6f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:14.068032 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6da0653f-e7a5-4b69-bc9b-4d4c46098a6f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:14.078221 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6da0653f-e7a5-4b69-bc9b-4d4c46098a6f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:14.079800 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6da0653f-e7a5-4b69-bc9b-4d4c46098a6f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:14.081043 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6da0653f-e7a5-4b69-bc9b-4d4c46098a6f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.169744 Jul 22 22:14:14.081592 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 51/101] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:13 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:14.841658 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4e56c670-54b2-47ee-8be9-d0fd6234edcc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:14.842264 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4e56c670-54b2-47ee-8be9-d0fd6234edcc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:14.849042 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4e56c670-54b2-47ee-8be9-d0fd6234edcc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:14.849501 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4e56c670-54b2-47ee-8be9-d0fd6234edcc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:14.850546 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4e56c670-54b2-47ee-8be9-d0fd6234edcc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:14.850975 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4e56c670-54b2-47ee-8be9-d0fd6234edcc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:14.989750 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4e56c670-54b2-47ee-8be9-d0fd6234edcc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:14.997139 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4e56c670-54b2-47ee-8be9-d0fd6234edcc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.159150 Jul 22 22:14:14.997780 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 51/102] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:14 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:15.099381 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a3eb6c65-3138-4556-854f-3a10c94f4d99 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:15.099985 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a3eb6c65-3138-4556-854f-3a10c94f4d99 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:15.106455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a3eb6c65-3138-4556-854f-3a10c94f4d99 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:15.106893 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a3eb6c65-3138-4556-854f-3a10c94f4d99 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:15.107652 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a3eb6c65-3138-4556-854f-3a10c94f4d99 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:15.108078 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a3eb6c65-3138-4556-854f-3a10c94f4d99 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:15.274182 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a3eb6c65-3138-4556-854f-3a10c94f4d99 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:15.286480 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a3eb6c65-3138-4556-854f-3a10c94f4d99 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:15.288920 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a3eb6c65-3138-4556-854f-3a10c94f4d99 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:15.290015 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a3eb6c65-3138-4556-854f-3a10c94f4d99 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.195065 Jul 22 22:14:15.290875 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 52/103] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:15 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:16.013837 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-93001480-2496-42dc-a3f1-2d450829e2c0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:16.014452 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-93001480-2496-42dc-a3f1-2d450829e2c0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:16.021121 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-93001480-2496-42dc-a3f1-2d450829e2c0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:16.021570 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-93001480-2496-42dc-a3f1-2d450829e2c0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:16.022345 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-93001480-2496-42dc-a3f1-2d450829e2c0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:16.022779 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-93001480-2496-42dc-a3f1-2d450829e2c0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:16.173621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-93001480-2496-42dc-a3f1-2d450829e2c0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:16.181613 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-93001480-2496-42dc-a3f1-2d450829e2c0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1368 microversion: 2.1 time: 0.171343 Jul 22 22:14:16.182226 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 52/104] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:16 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:16.313009 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1d004078-85cc-404d-b8ef-6179de765e33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:16.314765 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1d004078-85cc-404d-b8ef-6179de765e33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:16.323586 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d004078-85cc-404d-b8ef-6179de765e33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:16.324498 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d004078-85cc-404d-b8ef-6179de765e33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:16.325376 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d004078-85cc-404d-b8ef-6179de765e33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:16.325913 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d004078-85cc-404d-b8ef-6179de765e33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:16.464845 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1d004078-85cc-404d-b8ef-6179de765e33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:16.472579 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1d004078-85cc-404d-b8ef-6179de765e33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:16.474052 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1d004078-85cc-404d-b8ef-6179de765e33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:16.475152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1d004078-85cc-404d-b8ef-6179de765e33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.169643 Jul 22 22:14:16.475705 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 53/105] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:16 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:17.198217 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e174653a-959e-49ee-8658-9770c02edf83 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:17.199758 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e174653a-959e-49ee-8658-9770c02edf83 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:17.206455 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e174653a-959e-49ee-8658-9770c02edf83 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:17.206907 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e174653a-959e-49ee-8658-9770c02edf83 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:17.207715 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e174653a-959e-49ee-8658-9770c02edf83 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:17.208152 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e174653a-959e-49ee-8658-9770c02edf83 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:17.349237 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e174653a-959e-49ee-8658-9770c02edf83 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:17.357247 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e174653a-959e-49ee-8658-9770c02edf83 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1555 microversion: 2.1 time: 0.163133 Jul 22 22:14:17.371416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 53/106] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:17 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:17.378045 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5f1c34c0-75b9-410e-8491-ecb0c60041f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:17.378506 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5f1c34c0-75b9-410e-8491-ecb0c60041f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:17.384623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5f1c34c0-75b9-410e-8491-ecb0c60041f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:17.385087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5f1c34c0-75b9-410e-8491-ecb0c60041f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:17.385849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5f1c34c0-75b9-410e-8491-ecb0c60041f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:17.386291 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5f1c34c0-75b9-410e-8491-ecb0c60041f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:17.493549 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ae282011-00d3-48f0-8b59-796b9bc44bb8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:17.494076 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ae282011-00d3-48f0-8b59-796b9bc44bb8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:17.499942 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae282011-00d3-48f0-8b59-796b9bc44bb8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:17.500431 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae282011-00d3-48f0-8b59-796b9bc44bb8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:17.501376 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae282011-00d3-48f0-8b59-796b9bc44bb8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:17.502410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae282011-00d3-48f0-8b59-796b9bc44bb8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:17.520348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5f1c34c0-75b9-410e-8491-ecb0c60041f1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146769 Jul 22 22:14:17.521494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 54/107] 10.222.0.110 () {58 vars in 1280 bytes} [Thu Jul 22 22:14:17 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/os-interface => generated 285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:14:17.890084 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-8ec98ce7-f479-4ed2-b952-29d8ffdbfa33 req-34fee798-551f-46a9-ad87-1dbb3d7a9205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e7dd91-3f55-48c9-85aa-84c2450719f2", "name": "network-vif-plugged", "status": "completed", "tag": "e63aa00d-561e-478c-ad51-2858e1d33423"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:17.891685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:14:17.891685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:14:17.900995 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-8ec98ce7-f479-4ed2-b952-29d8ffdbfa33 req-34fee798-551f-46a9-ad87-1dbb3d7a9205 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:17.901634 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-8ec98ce7-f479-4ed2-b952-29d8ffdbfa33 req-34fee798-551f-46a9-ad87-1dbb3d7a9205 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:17.909343 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ae282011-00d3-48f0-8b59-796b9bc44bb8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:17.922053 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-8ec98ce7-f479-4ed2-b952-29d8ffdbfa33 req-34fee798-551f-46a9-ad87-1dbb3d7a9205 service nova] Creating event network-vif-plugged:e63aa00d-561e-478c-ad51-2858e1d33423 for instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 on hv-cinder-80186 Jul 22 22:14:17.925421 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ae282011-00d3-48f0-8b59-796b9bc44bb8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:17.926918 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ae282011-00d3-48f0-8b59-796b9bc44bb8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:17.928315 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ae282011-00d3-48f0-8b59-796b9bc44bb8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.438521 Jul 22 22:14:17.929120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 54/108] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:17 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:14:17.942112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-8ec98ce7-f479-4ed2-b952-29d8ffdbfa33 req-34fee798-551f-46a9-ad87-1dbb3d7a9205 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055572 Jul 22 22:14:17.943159 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 55/109] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:14:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:14:18.364012 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-69c64535-8da8-4ce1-8a04-75fca179021b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10c67547-2029-4531-8cea-2ff7fd292bdb"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:18.366206 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-69c64535-8da8-4ce1-8a04-75fca179021b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:18.383117 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-69c64535-8da8-4ce1-8a04-75fca179021b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:18.392881 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-69c64535-8da8-4ce1-8a04-75fca179021b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:18.394161 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-69c64535-8da8-4ce1-8a04-75fca179021b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:18.394729 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-69c64535-8da8-4ce1-8a04-75fca179021b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:18.742182 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-923ab7ed-b879-4768-b28b-5a34f0ad65e3 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31935d81-8640-4d2a-b2cd-af87aa403e3d"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:18.746303 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-923ab7ed-b879-4768-b28b-5a34f0ad65e3 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:18.769267 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-923ab7ed-b879-4768-b28b-5a34f0ad65e3 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:18.770967 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-923ab7ed-b879-4768-b28b-5a34f0ad65e3 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:18.771779 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-923ab7ed-b879-4768-b28b-5a34f0ad65e3 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:18.772216 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-923ab7ed-b879-4768-b28b-5a34f0ad65e3 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:18.971219 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-69c64535-8da8-4ce1-8a04-75fca179021b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "POST /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.614188 Jul 22 22:14:18.977975 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 55/110] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:14:18 2021] POST /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245/os-volume_attachments => generated 194 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:14:18.984749 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b17dbb17-5dcf-441c-86dc-272b144c2e19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:18.985696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b17dbb17-5dcf-441c-86dc-272b144c2e19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:18.993023 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b17dbb17-5dcf-441c-86dc-272b144c2e19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:18.993873 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b17dbb17-5dcf-441c-86dc-272b144c2e19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:18.994871 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b17dbb17-5dcf-441c-86dc-272b144c2e19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:18.995306 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b17dbb17-5dcf-441c-86dc-272b144c2e19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:19.310902 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b17dbb17-5dcf-441c-86dc-272b144c2e19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:19.321114 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b17dbb17-5dcf-441c-86dc-272b144c2e19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:19.322705 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b17dbb17-5dcf-441c-86dc-272b144c2e19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:19.324083 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b17dbb17-5dcf-441c-86dc-272b144c2e19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.344609 Jul 22 22:14:19.324697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 56/111] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:18 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:19.433327 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2b1fd082-69a2-46cf-80cc-e1c13caddb16 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:19.434346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2b1fd082-69a2-46cf-80cc-e1c13caddb16 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:19.442582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b1fd082-69a2-46cf-80cc-e1c13caddb16 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:19.443389 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b1fd082-69a2-46cf-80cc-e1c13caddb16 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:19.444487 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b1fd082-69a2-46cf-80cc-e1c13caddb16 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:19.445130 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b1fd082-69a2-46cf-80cc-e1c13caddb16 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:19.919468 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2b1fd082-69a2-46cf-80cc-e1c13caddb16 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 0.489787 Jul 22 22:14:19.920261 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 57/112] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:19 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:14:19.928424 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-a9c26725-2670-4976-a383-4ee5bbce3fa0 req-db01ee00-d0f0-4f23-98bf-ef6097499009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c", "tag": "ca634450-7b4f-4ad9-a31e-a585086203cf"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:19.930693 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:14:19.930693 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:14:19.959638 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-a9c26725-2670-4976-a383-4ee5bbce3fa0 req-db01ee00-d0f0-4f23-98bf-ef6097499009 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:19.960289 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-a9c26725-2670-4976-a383-4ee5bbce3fa0 req-db01ee00-d0f0-4f23-98bf-ef6097499009 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:19.993908 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-a9c26725-2670-4976-a383-4ee5bbce3fa0 req-db01ee00-d0f0-4f23-98bf-ef6097499009 service nova] Creating event network-changed:ca634450-7b4f-4ad9-a31e-a585086203cf for instance 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c on hv-cinder-80186 Jul 22 22:14:19.999361 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-a9c26725-2670-4976-a383-4ee5bbce3fa0 req-db01ee00-d0f0-4f23-98bf-ef6097499009 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076994 Jul 22 22:14:19.999956 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 58/113] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:14:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:14:20.068432 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-923ab7ed-b879-4768-b28b-5a34f0ad65e3 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "POST /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.341358 Jul 22 22:14:20.069530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 56/114] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:14:18 2021] POST /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f/os-volume_attachments => generated 194 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:14:20.347009 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b9413415-8083-493e-9638-74bd44caa9b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:20.347756 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b9413415-8083-493e-9638-74bd44caa9b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:20.365368 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b9413415-8083-493e-9638-74bd44caa9b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:20.368492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b9413415-8083-493e-9638-74bd44caa9b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:20.369608 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b9413415-8083-493e-9638-74bd44caa9b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:20.372166 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b9413415-8083-493e-9638-74bd44caa9b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:20.711472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b9413415-8083-493e-9638-74bd44caa9b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:20.723244 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b9413415-8083-493e-9638-74bd44caa9b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:20.727692 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b9413415-8083-493e-9638-74bd44caa9b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:20.729122 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b9413415-8083-493e-9638-74bd44caa9b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.389788 Jul 22 22:14:20.732109 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 59/115] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:20 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:20.932802 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ac962b34-c48d-43ac-ac56-243ba3b48ff0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:20.937120 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ac962b34-c48d-43ac-ac56-243ba3b48ff0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:20.948217 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ac962b34-c48d-43ac-ac56-243ba3b48ff0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:20.948887 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ac962b34-c48d-43ac-ac56-243ba3b48ff0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:20.950156 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ac962b34-c48d-43ac-ac56-243ba3b48ff0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:20.950704 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ac962b34-c48d-43ac-ac56-243ba3b48ff0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:21.206872 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ac962b34-c48d-43ac-ac56-243ba3b48ff0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 0.279906 Jul 22 22:14:21.207927 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 57/116] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:20 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:14:21.748200 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e5839dd7-c045-4a5a-8296-a8da74047aaa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:21.748963 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e5839dd7-c045-4a5a-8296-a8da74047aaa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:21.760740 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e5839dd7-c045-4a5a-8296-a8da74047aaa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:21.762736 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e5839dd7-c045-4a5a-8296-a8da74047aaa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:21.765603 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e5839dd7-c045-4a5a-8296-a8da74047aaa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:21.766210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e5839dd7-c045-4a5a-8296-a8da74047aaa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:21.990140 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e5839dd7-c045-4a5a-8296-a8da74047aaa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:21.998250 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e5839dd7-c045-4a5a-8296-a8da74047aaa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:21.999744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e5839dd7-c045-4a5a-8296-a8da74047aaa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:22.001064 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e5839dd7-c045-4a5a-8296-a8da74047aaa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1412 microversion: 2.20 time: 0.257013 Jul 22 22:14:22.012904 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 60/117] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:21 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1412 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:22.218309 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-49a328df-09fe-4030-8a39-b128cbf6eff6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:22.219318 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-49a328df-09fe-4030-8a39-b128cbf6eff6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:22.226979 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49a328df-09fe-4030-8a39-b128cbf6eff6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:22.228394 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49a328df-09fe-4030-8a39-b128cbf6eff6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:22.229601 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49a328df-09fe-4030-8a39-b128cbf6eff6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:22.230319 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49a328df-09fe-4030-8a39-b128cbf6eff6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:22.417604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-49a328df-09fe-4030-8a39-b128cbf6eff6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 0.203038 Jul 22 22:14:22.418434 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 58/118] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:22 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:14:23.020054 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-abb91f77-cfbd-4c9c-8c4e-24761cd5fea6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:23.021391 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-abb91f77-cfbd-4c9c-8c4e-24761cd5fea6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:23.030192 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-abb91f77-cfbd-4c9c-8c4e-24761cd5fea6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:23.030742 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-abb91f77-cfbd-4c9c-8c4e-24761cd5fea6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:23.031558 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-abb91f77-cfbd-4c9c-8c4e-24761cd5fea6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:23.032255 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-abb91f77-cfbd-4c9c-8c4e-24761cd5fea6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:23.300175 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-abb91f77-cfbd-4c9c-8c4e-24761cd5fea6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:23.308578 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-abb91f77-cfbd-4c9c-8c4e-24761cd5fea6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:23.310501 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-abb91f77-cfbd-4c9c-8c4e-24761cd5fea6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:23.311904 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-abb91f77-cfbd-4c9c-8c4e-24761cd5fea6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1603 microversion: 2.20 time: 0.295727 Jul 22 22:14:23.335843 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9f10fdd5-9696-454c-8f4b-28dfcb936750 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:23.338341 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9f10fdd5-9696-454c-8f4b-28dfcb936750 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:23.350368 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 61/119] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:14:23 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1603 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:23.353703 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9f10fdd5-9696-454c-8f4b-28dfcb936750 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:23.357987 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9f10fdd5-9696-454c-8f4b-28dfcb936750 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:23.359255 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9f10fdd5-9696-454c-8f4b-28dfcb936750 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:23.363505 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9f10fdd5-9696-454c-8f4b-28dfcb936750 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:23.428911 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6417936a-9c81-4875-ab4f-d3ac5777e16e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:23.430031 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6417936a-9c81-4875-ab4f-d3ac5777e16e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:23.437257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6417936a-9c81-4875-ab4f-d3ac5777e16e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:23.437726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6417936a-9c81-4875-ab4f-d3ac5777e16e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:23.438540 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6417936a-9c81-4875-ab4f-d3ac5777e16e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:23.439229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6417936a-9c81-4875-ab4f-d3ac5777e16e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:23.606960 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9f10fdd5-9696-454c-8f4b-28dfcb936750 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.279833 Jul 22 22:14:23.607480 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6417936a-9c81-4875-ab4f-d3ac5777e16e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 0.182298 Jul 22 22:14:23.607639 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 59/120] 10.222.0.110 () {60 vars in 1321 bytes} [Thu Jul 22 22:14:23 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/os-interface => generated 284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:14:23.611515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 62/121] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:23 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:14:24.619116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a960dd85-6e44-49fb-ad84-9f2a986ba496 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:24.621120 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a960dd85-6e44-49fb-ad84-9f2a986ba496 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:24.633878 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a960dd85-6e44-49fb-ad84-9f2a986ba496 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:24.635961 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a960dd85-6e44-49fb-ad84-9f2a986ba496 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:24.637104 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a960dd85-6e44-49fb-ad84-9f2a986ba496 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:24.640776 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a960dd85-6e44-49fb-ad84-9f2a986ba496 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:24.792626 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a960dd85-6e44-49fb-ad84-9f2a986ba496 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 0.177131 Jul 22 22:14:24.796058 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 60/122] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:24 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:14:25.187257 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-a5f1f910-96ec-4496-9dd5-b2d409cb944b req-b5ce0bf0-7524-4a61-9ae0-5cf12ad9b6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61e7dd91-3f55-48c9-85aa-84c2450719f2", "tag": "e63aa00d-561e-478c-ad51-2858e1d33423"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:25.188753 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:14:25.188753 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:14:25.190432 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2df87c8f-bef4-4ba3-baa4-b07d97ce68b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:25.191636 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2df87c8f-bef4-4ba3-baa4-b07d97ce68b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:25.210850 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-a5f1f910-96ec-4496-9dd5-b2d409cb944b req-b5ce0bf0-7524-4a61-9ae0-5cf12ad9b6f6 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:25.211320 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-a5f1f910-96ec-4496-9dd5-b2d409cb944b req-b5ce0bf0-7524-4a61-9ae0-5cf12ad9b6f6 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:25.215639 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2df87c8f-bef4-4ba3-baa4-b07d97ce68b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:25.217440 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2df87c8f-bef4-4ba3-baa4-b07d97ce68b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:25.222133 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2df87c8f-bef4-4ba3-baa4-b07d97ce68b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:25.224308 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2df87c8f-bef4-4ba3-baa4-b07d97ce68b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:25.257812 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-a5f1f910-96ec-4496-9dd5-b2d409cb944b req-b5ce0bf0-7524-4a61-9ae0-5cf12ad9b6f6 service nova] Creating event network-changed:e63aa00d-561e-478c-ad51-2858e1d33423 for instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 on hv-cinder-80186 Jul 22 22:14:25.267506 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-a5f1f910-96ec-4496-9dd5-b2d409cb944b req-b5ce0bf0-7524-4a61-9ae0-5cf12ad9b6f6 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081140 Jul 22 22:14:25.268412 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 61/123] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:14:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:14:25.521263 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2df87c8f-bef4-4ba3-baa4-b07d97ce68b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 14 microversion: 2.20 time: 0.345808 Jul 22 22:14:25.525550 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 63/124] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:25 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 14 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:25.805872 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9a6b55d4-a67b-4174-8d94-e3c15a1c891d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:25.807020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9a6b55d4-a67b-4174-8d94-e3c15a1c891d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:25.815959 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9a6b55d4-a67b-4174-8d94-e3c15a1c891d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:25.817300 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9a6b55d4-a67b-4174-8d94-e3c15a1c891d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:25.817300 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9a6b55d4-a67b-4174-8d94-e3c15a1c891d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:25.817613 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9a6b55d4-a67b-4174-8d94-e3c15a1c891d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:26.006367 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9a6b55d4-a67b-4174-8d94-e3c15a1c891d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 0.205272 Jul 22 22:14:26.007425 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 62/125] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:25 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:14:26.536256 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-11e1f1b9-98a0-4fcc-8490-5c1afbe511ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:26.538684 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-11e1f1b9-98a0-4fcc-8490-5c1afbe511ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:26.558325 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-11e1f1b9-98a0-4fcc-8490-5c1afbe511ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:26.558857 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-11e1f1b9-98a0-4fcc-8490-5c1afbe511ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:26.559683 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-11e1f1b9-98a0-4fcc-8490-5c1afbe511ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:26.560123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-11e1f1b9-98a0-4fcc-8490-5c1afbe511ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:26.781006 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-11e1f1b9-98a0-4fcc-8490-5c1afbe511ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 14 microversion: 2.20 time: 0.250906 Jul 22 22:14:26.785393 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 64/126] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:26 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 14 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:27.020223 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c7da23ce-8e89-41fe-95eb-2e36a2ca736b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:27.022003 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c7da23ce-8e89-41fe-95eb-2e36a2ca736b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:27.028715 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c7da23ce-8e89-41fe-95eb-2e36a2ca736b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:27.029422 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c7da23ce-8e89-41fe-95eb-2e36a2ca736b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:27.030605 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c7da23ce-8e89-41fe-95eb-2e36a2ca736b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:27.031144 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c7da23ce-8e89-41fe-95eb-2e36a2ca736b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:27.203299 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c7da23ce-8e89-41fe-95eb-2e36a2ca736b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 0.187241 Jul 22 22:14:27.204202 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 63/127] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:27 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:14:27.793923 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b6110b0e-9917-42a5-9be4-774693203673 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:27.795077 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b6110b0e-9917-42a5-9be4-774693203673 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:27.802444 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b6110b0e-9917-42a5-9be4-774693203673 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:27.803067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b6110b0e-9917-42a5-9be4-774693203673 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:27.817493 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b6110b0e-9917-42a5-9be4-774693203673 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:27.818385 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b6110b0e-9917-42a5-9be4-774693203673 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:28.004808 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b6110b0e-9917-42a5-9be4-774693203673 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 14 microversion: 2.20 time: 0.215282 Jul 22 22:14:28.008230 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 65/128] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:27 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:28.215433 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-35485b46-109b-41fc-8962-64a4ee1597a5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:28.217147 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-35485b46-109b-41fc-8962-64a4ee1597a5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:28.225568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35485b46-109b-41fc-8962-64a4ee1597a5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:28.226017 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35485b46-109b-41fc-8962-64a4ee1597a5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:28.227408 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35485b46-109b-41fc-8962-64a4ee1597a5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:28.228478 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35485b46-109b-41fc-8962-64a4ee1597a5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:28.407463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-35485b46-109b-41fc-8962-64a4ee1597a5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 0.195937 Jul 22 22:14:28.408914 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 64/129] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:28 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:14:29.015468 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-056e61f4-2fd5-4018-a8e6-2b43695c75a5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:29.016495 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-056e61f4-2fd5-4018-a8e6-2b43695c75a5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:29.024215 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-056e61f4-2fd5-4018-a8e6-2b43695c75a5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:29.024702 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-056e61f4-2fd5-4018-a8e6-2b43695c75a5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:29.025465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-056e61f4-2fd5-4018-a8e6-2b43695c75a5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:29.025899 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-056e61f4-2fd5-4018-a8e6-2b43695c75a5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:29.171474 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-056e61f4-2fd5-4018-a8e6-2b43695c75a5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 14 microversion: 2.20 time: 0.159515 Jul 22 22:14:29.171785 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 66/130] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:29 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:29.420072 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-15da72bd-a1e9-4ced-a182-5275a3648d18 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:29.421142 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-15da72bd-a1e9-4ced-a182-5275a3648d18 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:29.428495 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-15da72bd-a1e9-4ced-a182-5275a3648d18 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:29.428940 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-15da72bd-a1e9-4ced-a182-5275a3648d18 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:29.429714 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-15da72bd-a1e9-4ced-a182-5275a3648d18 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:29.430148 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-15da72bd-a1e9-4ced-a182-5275a3648d18 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:29.651651 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-15da72bd-a1e9-4ced-a182-5275a3648d18 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 0.235485 Jul 22 22:14:29.652346 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 65/131] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:29 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:14:30.183682 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1184fa5a-62bd-4833-a8e4-b41ebf884d68 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:30.184701 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1184fa5a-62bd-4833-a8e4-b41ebf884d68 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:30.193031 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1184fa5a-62bd-4833-a8e4-b41ebf884d68 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:30.193466 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1184fa5a-62bd-4833-a8e4-b41ebf884d68 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:30.194244 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1184fa5a-62bd-4833-a8e4-b41ebf884d68 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:30.194812 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1184fa5a-62bd-4833-a8e4-b41ebf884d68 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:30.398061 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1184fa5a-62bd-4833-a8e4-b41ebf884d68 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 14 microversion: 2.20 time: 0.218453 Jul 22 22:14:30.398700 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 67/132] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:30 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:30.664437 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-102d87c5-09d3-4793-b051-c1b93a1f8aca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:30.665483 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-102d87c5-09d3-4793-b051-c1b93a1f8aca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:30.671536 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-102d87c5-09d3-4793-b051-c1b93a1f8aca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:30.671944 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-102d87c5-09d3-4793-b051-c1b93a1f8aca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:30.672743 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-102d87c5-09d3-4793-b051-c1b93a1f8aca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:30.673170 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-102d87c5-09d3-4793-b051-c1b93a1f8aca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:31.202785 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-358184625", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "networks": [{"uuid": "2efa360b-cc3d-49e4-a8a0-1edcaa3e915e"}]}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:31.260033 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.network.neutron [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] validate_networks() for [('2efa360b-cc3d-49e4-a8a0-1edcaa3e915e', None, None, None)] {{(pid=107498) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:14:31.675405 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Flavor limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:14:31.675927 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Image limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:14:31.676558 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Flavor pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:14:31.676983 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Image pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:14:31.677408 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:14:31.687236 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:31.687675 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:31.688498 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:31.688927 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:31.707508 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Getting quotas for project 71bffb8e6c93437cb3fdbc82d8300750. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:14:31.712588 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Getting quotas for user 7438b1d834bd4e5f91ae4169e6b3a543 and project 71bffb8e6c93437cb3fdbc82d8300750. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:14:31.725939 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Going to run 1 instances... {{(pid=107498) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:14:31.728638 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:14:31.776492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3865bb36-c931-492a-a9f4-fb9820bfc345 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.577725 Jul 22 22:14:31.777338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 68/133] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:14:31 2021] POST /compute/v2.1/servers => generated 382 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 22 22:14:31.781805 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-948ceda8-8a8b-41bc-81e9-940bd1662db6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:31.782889 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-948ceda8-8a8b-41bc-81e9-940bd1662db6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:31.790027 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-948ceda8-8a8b-41bc-81e9-940bd1662db6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:31.790555 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-948ceda8-8a8b-41bc-81e9-940bd1662db6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:31.791394 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-948ceda8-8a8b-41bc-81e9-940bd1662db6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:31.791827 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-948ceda8-8a8b-41bc-81e9-940bd1662db6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:35.103332 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-102d87c5-09d3-4793-b051-c1b93a1f8aca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 4.444124 Jul 22 22:14:35.106648 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 66/134] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:30 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 4449 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:14:35.111896 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-439efb01-af81-44be-994e-be39426d7051 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:35.113113 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-439efb01-af81-44be-994e-be39426d7051 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:35.120026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-439efb01-af81-44be-994e-be39426d7051 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:35.120898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-439efb01-af81-44be-994e-be39426d7051 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:35.121263 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-439efb01-af81-44be-994e-be39426d7051 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:35.121742 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-439efb01-af81-44be-994e-be39426d7051 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:35.188087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-439efb01-af81-44be-994e-be39426d7051 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:35.196451 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-439efb01-af81-44be-994e-be39426d7051 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1217 microversion: 2.1 time: 0.088285 Jul 22 22:14:35.197340 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 67/135] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:35 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:35.329484 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-948ceda8-8a8b-41bc-81e9-940bd1662db6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 14 microversion: 2.20 time: 3.551066 Jul 22 22:14:35.330744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 69/136] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:31 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 14 bytes in 3552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:36.115037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-20972d4a-89cf-403f-a35a-3e5c972202c7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:36.116035 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-20972d4a-89cf-403f-a35a-3e5c972202c7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:36.123216 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20972d4a-89cf-403f-a35a-3e5c972202c7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:36.123660 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20972d4a-89cf-403f-a35a-3e5c972202c7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:36.124483 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20972d4a-89cf-403f-a35a-3e5c972202c7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:36.124915 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20972d4a-89cf-403f-a35a-3e5c972202c7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:36.215140 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-04154179-75e4-4d01-93d8-425141928a98 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:36.215929 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-04154179-75e4-4d01-93d8-425141928a98 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:36.225051 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04154179-75e4-4d01-93d8-425141928a98 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:36.225384 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04154179-75e4-4d01-93d8-425141928a98 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:36.226684 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04154179-75e4-4d01-93d8-425141928a98 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:36.227400 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04154179-75e4-4d01-93d8-425141928a98 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:36.312914 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-04154179-75e4-4d01-93d8-425141928a98 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:36.322228 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-04154179-75e4-4d01-93d8-425141928a98 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1281 microversion: 2.1 time: 0.111199 Jul 22 22:14:36.322819 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 70/137] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:36 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1281 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:36.341790 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4d5f53c9-5dec-49a7-b0cc-f38c023df587 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:36.343367 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4d5f53c9-5dec-49a7-b0cc-f38c023df587 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:36.351634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d5f53c9-5dec-49a7-b0cc-f38c023df587 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:36.353014 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d5f53c9-5dec-49a7-b0cc-f38c023df587 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:36.354388 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d5f53c9-5dec-49a7-b0cc-f38c023df587 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:36.354977 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d5f53c9-5dec-49a7-b0cc-f38c023df587 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:36.375018 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-20972d4a-89cf-403f-a35a-3e5c972202c7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 0.264354 Jul 22 22:14:36.375649 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 68/138] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:36 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:14:36.557391 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4d5f53c9-5dec-49a7-b0cc-f38c023df587 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 14 microversion: 2.20 time: 0.219327 Jul 22 22:14:36.557391 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 71/139] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:36 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 14 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:37.354348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-37d22052-0a46-4a58-9a63-c349dba2ece7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:37.357492 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-37d22052-0a46-4a58-9a63-c349dba2ece7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:37.369194 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37d22052-0a46-4a58-9a63-c349dba2ece7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:37.370832 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37d22052-0a46-4a58-9a63-c349dba2ece7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:37.371940 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37d22052-0a46-4a58-9a63-c349dba2ece7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:37.372997 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37d22052-0a46-4a58-9a63-c349dba2ece7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:37.387759 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-51f77921-d135-4c83-b39d-04fb1367f5b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:37.389682 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-51f77921-d135-4c83-b39d-04fb1367f5b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:37.403486 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51f77921-d135-4c83-b39d-04fb1367f5b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:37.403943 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51f77921-d135-4c83-b39d-04fb1367f5b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:37.404849 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51f77921-d135-4c83-b39d-04fb1367f5b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:37.405195 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51f77921-d135-4c83-b39d-04fb1367f5b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:37.674976 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-37d22052-0a46-4a58-9a63-c349dba2ece7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:37.688325 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-37d22052-0a46-4a58-9a63-c349dba2ece7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1321 microversion: 2.1 time: 0.344268 Jul 22 22:14:37.688893 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 69/140] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:37 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:37.694945 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5621a4fa-25ed-427d-90a5-3e19b17f0132 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:37.695944 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5621a4fa-25ed-427d-90a5-3e19b17f0132 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:37.702255 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5621a4fa-25ed-427d-90a5-3e19b17f0132 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:37.702698 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5621a4fa-25ed-427d-90a5-3e19b17f0132 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:37.703479 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5621a4fa-25ed-427d-90a5-3e19b17f0132 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:37.704266 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5621a4fa-25ed-427d-90a5-3e19b17f0132 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:41.975445 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-51f77921-d135-4c83-b39d-04fb1367f5b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 4.592329 Jul 22 22:14:41.976805 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 72/141] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:37 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 4595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:14:41.983184 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-f7cf59e0-0a6f-4908-965c-3a81e9882e74 req-899c8995-e9ab-42bb-b7bb-dd97a150f6b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "010bd492-cc37-4210-b96a-17ed70f671f4", "tag": "978e58db-f735-4744-ba09-2529a5fc8452"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:41.985086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:14:41.985086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:14:41.995700 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-f7cf59e0-0a6f-4908-965c-3a81e9882e74 req-899c8995-e9ab-42bb-b7bb-dd97a150f6b9 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:42.005805 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-f7cf59e0-0a6f-4908-965c-3a81e9882e74 req-899c8995-e9ab-42bb-b7bb-dd97a150f6b9 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:42.011975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5621a4fa-25ed-427d-90a5-3e19b17f0132 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 14 microversion: 2.20 time: 4.321482 Jul 22 22:14:42.013564 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 70/142] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:37 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 14 bytes in 4324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:42.021401 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bd0b7fd7-7a7e-46ce-889a-e42edf4e0a3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:42.022467 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-bd0b7fd7-7a7e-46ce-889a-e42edf4e0a3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:42.039849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bd0b7fd7-7a7e-46ce-889a-e42edf4e0a3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:42.041077 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bd0b7fd7-7a7e-46ce-889a-e42edf4e0a3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:42.042890 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bd0b7fd7-7a7e-46ce-889a-e42edf4e0a3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:42.043960 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bd0b7fd7-7a7e-46ce-889a-e42edf4e0a3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:42.046978 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-f7cf59e0-0a6f-4908-965c-3a81e9882e74 req-899c8995-e9ab-42bb-b7bb-dd97a150f6b9 service nova] Creating event network-changed:978e58db-f735-4744-ba09-2529a5fc8452 for instance 010bd492-cc37-4210-b96a-17ed70f671f4 on hv-cinder-80186 Jul 22 22:14:42.057788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-f7cf59e0-0a6f-4908-965c-3a81e9882e74 req-899c8995-e9ab-42bb-b7bb-dd97a150f6b9 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078537 Jul 22 22:14:42.058853 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 73/143] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:14:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:14:42.274500 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-bd0b7fd7-7a7e-46ce-889a-e42edf4e0a3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:42.286787 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-bd0b7fd7-7a7e-46ce-889a-e42edf4e0a3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1321 microversion: 2.1 time: 0.271326 Jul 22 22:14:42.289417 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 71/144] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:42 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:42.989723 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2c98c68f-113f-4340-a1a4-1a9f301d3aab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:42.990841 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2c98c68f-113f-4340-a1a4-1a9f301d3aab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:43.003728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c98c68f-113f-4340-a1a4-1a9f301d3aab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:43.005987 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c98c68f-113f-4340-a1a4-1a9f301d3aab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:43.011451 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c98c68f-113f-4340-a1a4-1a9f301d3aab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:43.015729 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c98c68f-113f-4340-a1a4-1a9f301d3aab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:43.025816 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4d4126c8-ce17-4abd-b903-dac1a39c9bf9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:43.028385 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4d4126c8-ce17-4abd-b903-dac1a39c9bf9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:43.047941 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d4126c8-ce17-4abd-b903-dac1a39c9bf9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:43.048419 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d4126c8-ce17-4abd-b903-dac1a39c9bf9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:43.049729 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d4126c8-ce17-4abd-b903-dac1a39c9bf9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:43.050244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d4126c8-ce17-4abd-b903-dac1a39c9bf9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:43.275685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4d4126c8-ce17-4abd-b903-dac1a39c9bf9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 14 microversion: 2.20 time: 0.255483 Jul 22 22:14:43.279922 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 72/145] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:43 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 14 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:43.310953 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2c98c68f-113f-4340-a1a4-1a9f301d3aab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14 microversion: 2.1 time: 0.326644 Jul 22 22:14:43.311367 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 74/146] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:42 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:14:43.322121 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a0623272-88cf-42da-9265-c38f2f5ba9df tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:43.324688 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a0623272-88cf-42da-9265-c38f2f5ba9df tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:43.336979 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0623272-88cf-42da-9265-c38f2f5ba9df tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:43.337818 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0623272-88cf-42da-9265-c38f2f5ba9df tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:43.338838 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0623272-88cf-42da-9265-c38f2f5ba9df tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:43.339737 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0623272-88cf-42da-9265-c38f2f5ba9df tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:43.604098 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a0623272-88cf-42da-9265-c38f2f5ba9df tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:43.614347 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a0623272-88cf-42da-9265-c38f2f5ba9df tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1321 microversion: 2.1 time: 0.309636 Jul 22 22:14:43.615759 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 73/147] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:43 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:44.134087 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a61084d6-4c58-4053-989b-6b3d752e9674 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:44.135571 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a61084d6-4c58-4053-989b-6b3d752e9674 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:44.145459 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a61084d6-4c58-4053-989b-6b3d752e9674 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:44.146346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a61084d6-4c58-4053-989b-6b3d752e9674 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:44.147315 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a61084d6-4c58-4053-989b-6b3d752e9674 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:44.147908 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a61084d6-4c58-4053-989b-6b3d752e9674 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:44.197277 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a61084d6-4c58-4053-989b-6b3d752e9674 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:14:44.292446 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-73a17c9e-2f71-44e0-a894-532870881ebd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:44.293947 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-73a17c9e-2f71-44e0-a894-532870881ebd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:44.326129 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-73a17c9e-2f71-44e0-a894-532870881ebd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:44.328991 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-73a17c9e-2f71-44e0-a894-532870881ebd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:44.332755 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-73a17c9e-2f71-44e0-a894-532870881ebd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:44.334074 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-73a17c9e-2f71-44e0-a894-532870881ebd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:44.338203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a61084d6-4c58-4053-989b-6b3d752e9674 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "DELETE /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 204 len: 0 microversion: 2.1 time: 0.208748 Jul 22 22:14:44.338818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 75/148] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:14:44 2021] DELETE /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:14:44.360161 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2ea9b09e-e3a8-400c-939d-8fa33809276d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:44.362668 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2ea9b09e-e3a8-400c-939d-8fa33809276d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:44.384112 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2ea9b09e-e3a8-400c-939d-8fa33809276d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:44.384618 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2ea9b09e-e3a8-400c-939d-8fa33809276d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:44.385922 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2ea9b09e-e3a8-400c-939d-8fa33809276d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:44.387160 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2ea9b09e-e3a8-400c-939d-8fa33809276d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:44.645734 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-73a17c9e-2f71-44e0-a894-532870881ebd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 14 microversion: 2.20 time: 0.359729 Jul 22 22:14:44.646662 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 74/149] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:44 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 14 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:14:44.653100 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e767b3d1-9afc-4af0-ae7a-dc309c6a4731 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:44.653839 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e767b3d1-9afc-4af0-ae7a-dc309c6a4731 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:44.664306 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e767b3d1-9afc-4af0-ae7a-dc309c6a4731 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:44.665046 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e767b3d1-9afc-4af0-ae7a-dc309c6a4731 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:44.666334 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e767b3d1-9afc-4af0-ae7a-dc309c6a4731 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:44.667139 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e767b3d1-9afc-4af0-ae7a-dc309c6a4731 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:44.707807 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2ea9b09e-e3a8-400c-939d-8fa33809276d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 4056 microversion: 2.1 time: 0.364382 Jul 22 22:14:44.708998 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 76/150] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:44 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 4056 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:44.717462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a3be2ea4-7c9e-4ecc-9470-b2f015b672a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:44.718681 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a3be2ea4-7c9e-4ecc-9470-b2f015b672a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:44.726588 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3be2ea4-7c9e-4ecc-9470-b2f015b672a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:44.727639 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3be2ea4-7c9e-4ecc-9470-b2f015b672a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:44.728656 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3be2ea4-7c9e-4ecc-9470-b2f015b672a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:44.729472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3be2ea4-7c9e-4ecc-9470-b2f015b672a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:44.947254 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a3be2ea4-7c9e-4ecc-9470-b2f015b672a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:44.961857 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e767b3d1-9afc-4af0-ae7a-dc309c6a4731 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:44.982417 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a3be2ea4-7c9e-4ecc-9470-b2f015b672a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1321 microversion: 2.1 time: 0.268471 Jul 22 22:14:44.984247 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 77/151] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:44 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:44.989158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e767b3d1-9afc-4af0-ae7a-dc309c6a4731 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1557 microversion: 2.1 time: 0.340933 Jul 22 22:14:44.993095 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 75/152] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:44 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1557 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:45.659441 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a3f69995-6af6-4814-833c-3416d50b90f5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:45.660455 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a3f69995-6af6-4814-833c-3416d50b90f5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:45.667854 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3f69995-6af6-4814-833c-3416d50b90f5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:45.668356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3f69995-6af6-4814-833c-3416d50b90f5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:45.669149 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3f69995-6af6-4814-833c-3416d50b90f5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:45.669584 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3f69995-6af6-4814-833c-3416d50b90f5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:45.719663 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-95e167a6-188c-41a8-a46e-4a4704dc5aef tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:45.720539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-95e167a6-188c-41a8-a46e-4a4704dc5aef tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:45.728123 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-95e167a6-188c-41a8-a46e-4a4704dc5aef tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:45.728582 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-95e167a6-188c-41a8-a46e-4a4704dc5aef tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:45.729534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-95e167a6-188c-41a8-a46e-4a4704dc5aef tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:45.729963 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-95e167a6-188c-41a8-a46e-4a4704dc5aef tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:49.913646 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a3f69995-6af6-4814-833c-3416d50b90f5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 6451 microversion: 2.20 time: 4.258706 Jul 22 22:14:49.918651 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 78/153] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:45 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 6451 bytes in 4265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:14:49.929833 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bd338889-dfe8-4227-a705-b71a249a2d0c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:49.930853 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bd338889-dfe8-4227-a705-b71a249a2d0c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:49.972701 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd338889-dfe8-4227-a705-b71a249a2d0c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:49.974271 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd338889-dfe8-4227-a705-b71a249a2d0c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:49.977706 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd338889-dfe8-4227-a705-b71a249a2d0c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:49.980505 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd338889-dfe8-4227-a705-b71a249a2d0c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:50.005376 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-95e167a6-188c-41a8-a46e-4a4704dc5aef tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 14441 microversion: 2.1 time: 4.289266 Jul 22 22:14:50.009343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 76/154] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:45 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 14441 bytes in 4292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:14:50.016482 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a9a0fa22-8203-4334-95bc-0fdfea9bc1f1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:50.017262 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a9a0fa22-8203-4334-95bc-0fdfea9bc1f1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:50.043466 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9a0fa22-8203-4334-95bc-0fdfea9bc1f1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:50.043906 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9a0fa22-8203-4334-95bc-0fdfea9bc1f1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:50.044724 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9a0fa22-8203-4334-95bc-0fdfea9bc1f1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:50.045241 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9a0fa22-8203-4334-95bc-0fdfea9bc1f1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:50.352225 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bd338889-dfe8-4227-a705-b71a249a2d0c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:50.361869 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bd338889-dfe8-4227-a705-b71a249a2d0c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1321 microversion: 2.1 time: 0.440717 Jul 22 22:14:50.364903 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a9a0fa22-8203-4334-95bc-0fdfea9bc1f1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:50.365672 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 79/155] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:49 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1321 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:50.376083 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a9a0fa22-8203-4334-95bc-0fdfea9bc1f1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1557 microversion: 2.1 time: 0.368215 Jul 22 22:14:50.376828 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 77/156] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:50 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1557 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:50.926811 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0ca2fc36-7b0d-4269-8a92-a3950a52ad9b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:50.928120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0ca2fc36-7b0d-4269-8a92-a3950a52ad9b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:50.935920 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ca2fc36-7b0d-4269-8a92-a3950a52ad9b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:50.936589 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ca2fc36-7b0d-4269-8a92-a3950a52ad9b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:50.937659 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ca2fc36-7b0d-4269-8a92-a3950a52ad9b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:50.938086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ca2fc36-7b0d-4269-8a92-a3950a52ad9b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:51.027078 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-180475f3-1129-4c58-8af4-41777da81854 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:51.030045 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-180475f3-1129-4c58-8af4-41777da81854 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:51.047250 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-180475f3-1129-4c58-8af4-41777da81854 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:51.047923 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-180475f3-1129-4c58-8af4-41777da81854 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:51.049549 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-180475f3-1129-4c58-8af4-41777da81854 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:51.050674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-180475f3-1129-4c58-8af4-41777da81854 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:51.118651 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0ca2fc36-7b0d-4269-8a92-a3950a52ad9b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 7937 microversion: 2.20 time: 0.197179 Jul 22 22:14:51.119534 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 80/157] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:50 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 7937 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:14:51.276746 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-180475f3-1129-4c58-8af4-41777da81854 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 15651 microversion: 2.1 time: 0.260213 Jul 22 22:14:51.287391 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 78/158] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:51 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 15651 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:14:51.384133 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-24d19ca6-90fc-4004-a447-1bd04306866c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:51.384878 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-24d19ca6-90fc-4004-a447-1bd04306866c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:51.399909 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24d19ca6-90fc-4004-a447-1bd04306866c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:51.400221 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24d19ca6-90fc-4004-a447-1bd04306866c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:51.401082 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24d19ca6-90fc-4004-a447-1bd04306866c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:51.401528 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24d19ca6-90fc-4004-a447-1bd04306866c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:51.410748 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-10384d55-2fc7-49f1-9be5-860bf53fa17e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:51.411464 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-10384d55-2fc7-49f1-9be5-860bf53fa17e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:51.423012 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10384d55-2fc7-49f1-9be5-860bf53fa17e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:51.425825 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10384d55-2fc7-49f1-9be5-860bf53fa17e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:51.427860 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10384d55-2fc7-49f1-9be5-860bf53fa17e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:51.428557 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10384d55-2fc7-49f1-9be5-860bf53fa17e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:51.654669 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-24d19ca6-90fc-4004-a447-1bd04306866c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:51.667318 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-24d19ca6-90fc-4004-a447-1bd04306866c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1321 microversion: 2.1 time: 0.286684 Jul 22 22:14:51.685936 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 81/159] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:51 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:51.720313 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-10384d55-2fc7-49f1-9be5-860bf53fa17e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:51.731448 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-10384d55-2fc7-49f1-9be5-860bf53fa17e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1557 microversion: 2.1 time: 0.333957 Jul 22 22:14:51.732938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 79/160] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:51 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1557 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:52.131992 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3a7190da-0753-42a7-98a2-4f8a3028734c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:52.133771 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3a7190da-0753-42a7-98a2-4f8a3028734c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:52.153803 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3a7190da-0753-42a7-98a2-4f8a3028734c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:52.156632 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3a7190da-0753-42a7-98a2-4f8a3028734c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:52.157715 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3a7190da-0753-42a7-98a2-4f8a3028734c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:52.158913 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3a7190da-0753-42a7-98a2-4f8a3028734c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:52.290064 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0f8f887d-5e08-4646-8a25-8dc0daf8c7b1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:52.290979 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0f8f887d-5e08-4646-8a25-8dc0daf8c7b1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:52.297213 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0f8f887d-5e08-4646-8a25-8dc0daf8c7b1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:52.298158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0f8f887d-5e08-4646-8a25-8dc0daf8c7b1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:52.299928 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0f8f887d-5e08-4646-8a25-8dc0daf8c7b1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:52.300608 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0f8f887d-5e08-4646-8a25-8dc0daf8c7b1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:52.557862 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3a7190da-0753-42a7-98a2-4f8a3028734c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 10367 microversion: 2.20 time: 0.429847 Jul 22 22:14:52.558818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 82/161] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:52 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 10367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:14:52.710129 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0f8f887d-5e08-4646-8a25-8dc0daf8c7b1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 17602 microversion: 2.1 time: 0.422595 Jul 22 22:14:52.715515 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 80/162] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:52 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 17602 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:14:52.735502 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3e17abbb-f025-4556-bf1d-8488fb6b27b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:52.750813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f51a82f6-fed0-4038-9941-d457082b94a1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:52.751730 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f51a82f6-fed0-4038-9941-d457082b94a1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:52.756445 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3e17abbb-f025-4556-bf1d-8488fb6b27b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:52.769983 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f51a82f6-fed0-4038-9941-d457082b94a1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:52.771317 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f51a82f6-fed0-4038-9941-d457082b94a1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:52.771431 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f51a82f6-fed0-4038-9941-d457082b94a1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:52.772162 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f51a82f6-fed0-4038-9941-d457082b94a1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:52.786530 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e17abbb-f025-4556-bf1d-8488fb6b27b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:52.798009 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e17abbb-f025-4556-bf1d-8488fb6b27b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:52.799554 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e17abbb-f025-4556-bf1d-8488fb6b27b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:52.800189 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e17abbb-f025-4556-bf1d-8488fb6b27b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:53.039473 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f51a82f6-fed0-4038-9941-d457082b94a1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:53.048094 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f51a82f6-fed0-4038-9941-d457082b94a1 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1557 microversion: 2.1 time: 0.301592 Jul 22 22:14:53.063091 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 81/163] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:52 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1557 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:53.104749 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3e17abbb-f025-4556-bf1d-8488fb6b27b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:53.115227 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3e17abbb-f025-4556-bf1d-8488fb6b27b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1321 microversion: 2.1 time: 0.428733 Jul 22 22:14:53.125518 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 83/164] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:52 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1321 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:53.577512 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0131bc30-1457-4a07-92dc-d7872251aae1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:53.578535 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0131bc30-1457-4a07-92dc-d7872251aae1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:53.594331 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0131bc30-1457-4a07-92dc-d7872251aae1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:53.594780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0131bc30-1457-4a07-92dc-d7872251aae1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:53.596244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0131bc30-1457-4a07-92dc-d7872251aae1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:53.596846 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0131bc30-1457-4a07-92dc-d7872251aae1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:53.724215 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d5f59e8f-a491-4ef4-a019-1821559bdb75 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:53.725564 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d5f59e8f-a491-4ef4-a019-1821559bdb75 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:53.747299 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d5f59e8f-a491-4ef4-a019-1821559bdb75 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:53.749469 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d5f59e8f-a491-4ef4-a019-1821559bdb75 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:53.750477 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d5f59e8f-a491-4ef4-a019-1821559bdb75 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:53.758658 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d5f59e8f-a491-4ef4-a019-1821559bdb75 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:57.955333 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0131bc30-1457-4a07-92dc-d7872251aae1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 17990 microversion: 2.20 time: 4.385592 Jul 22 22:14:57.960759 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 82/165] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:53 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 17990 bytes in 4394 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:14:57.966902 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3c0143f2-105b-4000-a947-53c67e17eabd tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:57.968003 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3c0143f2-105b-4000-a947-53c67e17eabd tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:57.979425 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3c0143f2-105b-4000-a947-53c67e17eabd tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:57.979877 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3c0143f2-105b-4000-a947-53c67e17eabd tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:57.981012 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3c0143f2-105b-4000-a947-53c67e17eabd tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:57.981525 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3c0143f2-105b-4000-a947-53c67e17eabd tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:58.063058 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d5f59e8f-a491-4ef4-a019-1821559bdb75 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 21519 microversion: 2.1 time: 4.343866 Jul 22 22:14:58.064634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 84/166] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:53 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 21519 bytes in 4346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:14:58.069784 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bd94c206-2452-49e0-b738-856f90d8f036 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:58.070484 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bd94c206-2452-49e0-b738-856f90d8f036 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:58.089653 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd94c206-2452-49e0-b738-856f90d8f036 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:58.090664 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd94c206-2452-49e0-b738-856f90d8f036 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:58.091619 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd94c206-2452-49e0-b738-856f90d8f036 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:58.092202 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd94c206-2452-49e0-b738-856f90d8f036 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:58.278935 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3c0143f2-105b-4000-a947-53c67e17eabd tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:58.293026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3c0143f2-105b-4000-a947-53c67e17eabd tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1557 microversion: 2.1 time: 0.330615 Jul 22 22:14:58.293650 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 83/167] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:57 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1557 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:58.315762 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-52b9d794-8aed-4d49-96aa-6a4cc06924b6 req-bbcb0236-f06a-421e-a8f3-a935293b5e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010bd492-cc37-4210-b96a-17ed70f671f4", "name": "network-vif-plugged", "status": "completed", "tag": "978e58db-f735-4744-ba09-2529a5fc8452"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:58.317687 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:14:58.317687 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:14:58.327948 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-52b9d794-8aed-4d49-96aa-6a4cc06924b6 req-bbcb0236-f06a-421e-a8f3-a935293b5e43 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:58.331581 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-52b9d794-8aed-4d49-96aa-6a4cc06924b6 req-bbcb0236-f06a-421e-a8f3-a935293b5e43 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:58.349882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-52b9d794-8aed-4d49-96aa-6a4cc06924b6 req-bbcb0236-f06a-421e-a8f3-a935293b5e43 service nova] Creating event network-vif-plugged:978e58db-f735-4744-ba09-2529a5fc8452 for instance 010bd492-cc37-4210-b96a-17ed70f671f4 on hv-cinder-80186 Jul 22 22:14:58.369106 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-52b9d794-8aed-4d49-96aa-6a4cc06924b6 req-bbcb0236-f06a-421e-a8f3-a935293b5e43 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073178 Jul 22 22:14:58.369995 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 84/168] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:14:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:14:58.412402 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bd94c206-2452-49e0-b738-856f90d8f036 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:58.431071 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bd94c206-2452-49e0-b738-856f90d8f036 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1321 microversion: 2.1 time: 0.364732 Jul 22 22:14:58.432151 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 85/169] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:58 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:58.974246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-62fd412a-1b5b-451a-8105-da47ce0dc58c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:58.975477 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-62fd412a-1b5b-451a-8105-da47ce0dc58c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:58.979020 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-cb833556-d28a-4dfa-b719-bd4fd2096b59 req-f7563927-9b0e-493e-93e3-48f78a6b968c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73570a19-27c7-4bdc-b64c-a0c5e008ff3f", "name": "network-vif-deleted", "tag": "8c0d6a5f-9b31-4e52-a742-c404c46232c7"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:58.984225 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:14:58.984225 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:14:58.996079 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-62fd412a-1b5b-451a-8105-da47ce0dc58c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:58.996871 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-62fd412a-1b5b-451a-8105-da47ce0dc58c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:58.998980 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-cb833556-d28a-4dfa-b719-bd4fd2096b59 req-f7563927-9b0e-493e-93e3-48f78a6b968c service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:59.000123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-cb833556-d28a-4dfa-b719-bd4fd2096b59 req-f7563927-9b0e-493e-93e3-48f78a6b968c service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:59.019937 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-62fd412a-1b5b-451a-8105-da47ce0dc58c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:59.020636 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-62fd412a-1b5b-451a-8105-da47ce0dc58c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:59.024599 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-cb833556-d28a-4dfa-b719-bd4fd2096b59 req-f7563927-9b0e-493e-93e3-48f78a6b968c service nova] Creating event network-vif-deleted:8c0d6a5f-9b31-4e52-a742-c404c46232c7 for instance 73570a19-27c7-4bdc-b64c-a0c5e008ff3f on hv-cinder-80186 Jul 22 22:14:59.030328 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-cb833556-d28a-4dfa-b719-bd4fd2096b59 req-f7563927-9b0e-493e-93e3-48f78a6b968c service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063138 Jul 22 22:14:59.031286 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 86/170] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:14:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:14:59.077831 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0b6a8751-d3b0-4c95-a0d0-4114647e264c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:14:59.079812 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0b6a8751-d3b0-4c95-a0d0-4114647e264c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:59.087396 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b6a8751-d3b0-4c95-a0d0-4114647e264c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:59.087753 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b6a8751-d3b0-4c95-a0d0-4114647e264c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:59.089898 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b6a8751-d3b0-4c95-a0d0-4114647e264c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:59.089898 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b6a8751-d3b0-4c95-a0d0-4114647e264c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:59.634445 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-62fd412a-1b5b-451a-8105-da47ce0dc58c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 19342 microversion: 2.20 time: 0.667461 Jul 22 22:14:59.637608 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 85/171] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:14:58 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 19342 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:14:59.642778 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-34bd5b8c-89c9-4d2e-b6a4-1906bfaeb52e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:59.643479 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-34bd5b8c-89c9-4d2e-b6a4-1906bfaeb52e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:59.650388 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34bd5b8c-89c9-4d2e-b6a4-1906bfaeb52e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:59.650960 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34bd5b8c-89c9-4d2e-b6a4-1906bfaeb52e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:59.651738 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34bd5b8c-89c9-4d2e-b6a4-1906bfaeb52e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:59.652174 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34bd5b8c-89c9-4d2e-b6a4-1906bfaeb52e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:59.688515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0b6a8751-d3b0-4c95-a0d0-4114647e264c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 22954 microversion: 2.1 time: 0.614125 Jul 22 22:14:59.689943 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 87/172] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:14:59 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 22954 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:14:59.705622 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5cd1658e-5302-4d3a-ba75-50c3109e6290 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:14:59.707319 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5cd1658e-5302-4d3a-ba75-50c3109e6290 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:14:59.719952 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5cd1658e-5302-4d3a-ba75-50c3109e6290 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:59.723301 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5cd1658e-5302-4d3a-ba75-50c3109e6290 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:59.724873 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5cd1658e-5302-4d3a-ba75-50c3109e6290 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:14:59.725567 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5cd1658e-5302-4d3a-ba75-50c3109e6290 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:14:59.780026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-34bd5b8c-89c9-4d2e-b6a4-1906bfaeb52e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:59.797228 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-34bd5b8c-89c9-4d2e-b6a4-1906bfaeb52e tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1350 microversion: 2.1 time: 0.158177 Jul 22 22:14:59.800479 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 86/173] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:59 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:14:59.972480 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5cd1658e-5302-4d3a-ba75-50c3109e6290 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:14:59.982626 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5cd1658e-5302-4d3a-ba75-50c3109e6290 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1321 microversion: 2.1 time: 0.291149 Jul 22 22:14:59.993963 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 88/174] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:14:59 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1321 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:00.646778 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-729e2bd2-ab19-45c4-b273-d4bb07942d1c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:00.647812 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-729e2bd2-ab19-45c4-b273-d4bb07942d1c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:00.657237 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-729e2bd2-ab19-45c4-b273-d4bb07942d1c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:00.657991 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-729e2bd2-ab19-45c4-b273-d4bb07942d1c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:00.659073 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-729e2bd2-ab19-45c4-b273-d4bb07942d1c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:00.659683 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-729e2bd2-ab19-45c4-b273-d4bb07942d1c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:00.702496 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-402c3596-124a-4a73-a55c-ba85fb2e889d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:00.704053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-402c3596-124a-4a73-a55c-ba85fb2e889d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:00.722852 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-402c3596-124a-4a73-a55c-ba85fb2e889d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:00.723433 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-402c3596-124a-4a73-a55c-ba85fb2e889d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:00.725861 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-402c3596-124a-4a73-a55c-ba85fb2e889d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:00.726262 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-402c3596-124a-4a73-a55c-ba85fb2e889d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:00.953833 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-729e2bd2-ab19-45c4-b273-d4bb07942d1c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 20661 microversion: 2.20 time: 0.312113 Jul 22 22:15:00.955956 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 87/175] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:00 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 20661 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:00.963281 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-67fb5b81-366e-4a34-b63d-8fbe259ed235 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:00.965332 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-67fb5b81-366e-4a34-b63d-8fbe259ed235 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:00.973975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67fb5b81-366e-4a34-b63d-8fbe259ed235 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:00.974674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67fb5b81-366e-4a34-b63d-8fbe259ed235 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:00.975502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67fb5b81-366e-4a34-b63d-8fbe259ed235 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:00.976051 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67fb5b81-366e-4a34-b63d-8fbe259ed235 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:01.008134 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-402c3596-124a-4a73-a55c-ba85fb2e889d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 23237 microversion: 2.1 time: 0.307860 Jul 22 22:15:01.008856 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 89/176] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:00 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 23237 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:15:01.019489 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-71c90eb5-a345-4466-bdcd-7e2a6679882c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:01.020583 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-71c90eb5-a345-4466-bdcd-7e2a6679882c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:01.022458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67fb5b81-366e-4a34-b63d-8fbe259ed235 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:01.022913 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67fb5b81-366e-4a34-b63d-8fbe259ed235 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:01.023412 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-67fb5b81-366e-4a34-b63d-8fbe259ed235 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lazy-loading 'fault' on Instance uuid 73570a19-27c7-4bdc-b64c-a0c5e008ff3f {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:15:01.038039 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-71c90eb5-a345-4466-bdcd-7e2a6679882c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:01.038689 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-71c90eb5-a345-4466-bdcd-7e2a6679882c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:01.039572 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-71c90eb5-a345-4466-bdcd-7e2a6679882c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:01.041141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-71c90eb5-a345-4466-bdcd-7e2a6679882c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:01.167157 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-67fb5b81-366e-4a34-b63d-8fbe259ed235 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:01.177523 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-67fb5b81-366e-4a34-b63d-8fbe259ed235 tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1355 microversion: 2.1 time: 0.220335 Jul 22 22:15:01.178215 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 88/177] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:00 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1355 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:01.277313 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-71c90eb5-a345-4466-bdcd-7e2a6679882c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:01.288790 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-71c90eb5-a345-4466-bdcd-7e2a6679882c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1321 microversion: 2.1 time: 0.277940 Jul 22 22:15:01.289369 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 90/178] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:01 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:01.803226 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-515c47df-f34d-4cf2-be97-4fbd6517b840 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Action: 'create', calling method: .version_select at 0x7f7d181feee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1949086562"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:01.832159 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-515c47df-f34d-4cf2-be97-4fbd6517b840 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Getting quotas for project 75448bc245984a73a936769d77050816. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:15:01.835809 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-515c47df-f34d-4cf2-be97-4fbd6517b840 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Getting quotas for user 6ef90120c394459c89d43476995b9ea7 and project 75448bc245984a73a936769d77050816. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:15:01.967317 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-208d4fac-8466-4a76-b9f4-c480fa98fb1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:01.972165 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-208d4fac-8466-4a76-b9f4-c480fa98fb1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:01.978932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-208d4fac-8466-4a76-b9f4-c480fa98fb1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:01.979389 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-208d4fac-8466-4a76-b9f4-c480fa98fb1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:01.980226 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-208d4fac-8466-4a76-b9f4-c480fa98fb1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:01.980226 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-208d4fac-8466-4a76-b9f4-c480fa98fb1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:02.081177 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-515c47df-f34d-4cf2-be97-4fbd6517b840 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Getting quotas for project 75448bc245984a73a936769d77050816. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:15:02.085677 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-515c47df-f34d-4cf2-be97-4fbd6517b840 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Getting quotas for user 6ef90120c394459c89d43476995b9ea7 and project 75448bc245984a73a936769d77050816. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:15:02.100323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-515c47df-f34d-4cf2-be97-4fbd6517b840 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.300675 Jul 22 22:15:02.100932 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 89/179] 10.222.0.110 () {60 vars in 1163 bytes} [Thu Jul 22 22:15:01 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:02.107374 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-577be38a-c8d0-48c5-ae07-90a584d1c02d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:02.108424 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-577be38a-c8d0-48c5-ae07-90a584d1c02d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:02.116603 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-577be38a-c8d0-48c5-ae07-90a584d1c02d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:02.117060 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-577be38a-c8d0-48c5-ae07-90a584d1c02d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:02.117830 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-577be38a-c8d0-48c5-ae07-90a584d1c02d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:02.118265 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-577be38a-c8d0-48c5-ae07-90a584d1c02d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:06.485161 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-208d4fac-8466-4a76-b9f4-c480fa98fb1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 24504 microversion: 2.20 time: 4.521683 Jul 22 22:15:06.485837 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 91/180] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:01 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 24504 bytes in 4523 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:15:06.491686 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a35b67ff-9820-4c98-a4d0-6378b9615f4d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:06.492404 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a35b67ff-9820-4c98-a4d0-6378b9615f4d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:06.498890 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a35b67ff-9820-4c98-a4d0-6378b9615f4d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:06.499370 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a35b67ff-9820-4c98-a4d0-6378b9615f4d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:06.500147 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a35b67ff-9820-4c98-a4d0-6378b9615f4d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:06.500617 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a35b67ff-9820-4c98-a4d0-6378b9615f4d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:06.532988 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a35b67ff-9820-4c98-a4d0-6378b9615f4d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:06.533627 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a35b67ff-9820-4c98-a4d0-6378b9615f4d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:06.534275 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.objects.instance [None req-a35b67ff-9820-4c98-a4d0-6378b9615f4d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lazy-loading 'fault' on Instance uuid 73570a19-27c7-4bdc-b64c-a0c5e008ff3f {{(pid=107498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:15:06.565458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-577be38a-c8d0-48c5-ae07-90a584d1c02d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 25354 microversion: 2.1 time: 4.461649 Jul 22 22:15:06.569455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 90/181] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:02 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 25354 bytes in 4465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:06.571788 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1063229353", "imageRef": "2310b0c7-0a90-466e-8b25-2370e9ae8b1d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1949086562", "networks": [{"uuid": "b98d8b17-f6ee-4f00-a33f-f71777940457"}]}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:06.584686 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a35b67ff-9820-4c98-a4d0-6378b9615f4d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9c4420654d44379c06e0e33695b403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '131c422049c5444aa188ba5e9a4efc0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:06.596325 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a35b67ff-9820-4c98-a4d0-6378b9615f4d tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 200 len: 1355 microversion: 2.1 time: 0.108120 Jul 22 22:15:06.596901 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 92/182] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:06 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 1355 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:06.603661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b0225e11-ced2-4e21-aab6-e11c2f4c2da1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:06.603661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b0225e11-ced2-4e21-aab6-e11c2f4c2da1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:06.610522 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0225e11-ced2-4e21-aab6-e11c2f4c2da1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:06.611721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0225e11-ced2-4e21-aab6-e11c2f4c2da1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:06.612540 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0225e11-ced2-4e21-aab6-e11c2f4c2da1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:06.613106 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0225e11-ced2-4e21-aab6-e11c2f4c2da1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:06.643760 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.network.neutron [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] validate_networks() for [('b98d8b17-f6ee-4f00-a33f-f71777940457', None, None, None)] {{(pid=107499) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:15:06.797631 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b0225e11-ced2-4e21-aab6-e11c2f4c2da1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:06.806535 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b0225e11-ced2-4e21-aab6-e11c2f4c2da1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1321 microversion: 2.1 time: 0.208426 Jul 22 22:15:06.807122 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 93/183] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:06 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:07.165108 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Flavor limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:15:07.165523 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Image limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:15:07.165984 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Flavor pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:15:07.166381 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Image pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:15:07.166781 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:15:07.176722 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:07.177170 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:07.178162 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:07.178589 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:07.196912 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Getting quotas for project 75448bc245984a73a936769d77050816. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:15:07.200872 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Getting quotas for user 6ef90120c394459c89d43476995b9ea7 and project 75448bc245984a73a936769d77050816. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:15:07.214857 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Going to run 1 instances... {{(pid=107499) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:15:07.217234 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2310b0c7-0a90-466e-8b25-2370e9ae8b1d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107499) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:15:07.265965 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-57194601-575d-4467-b363-0ac09891ce50 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.698102 Jul 22 22:15:07.266518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 91/184] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:15:06 2021] POST /compute/v2.1/servers => generated 382 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:15:07.277370 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6f8027b9-6ab9-46b7-9766-c669697169a4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:07.278028 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6f8027b9-6ab9-46b7-9766-c669697169a4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:07.340135 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6f8027b9-6ab9-46b7-9766-c669697169a4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:07.347634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6f8027b9-6ab9-46b7-9766-c669697169a4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1263 microversion: 2.1 time: 0.073951 Jul 22 22:15:07.348569 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 94/185] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:07 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1263 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:07.502435 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ae6de385-81f1-4422-9342-45dfe1653639 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:07.504642 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ae6de385-81f1-4422-9342-45dfe1653639 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:07.514637 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae6de385-81f1-4422-9342-45dfe1653639 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:07.515385 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae6de385-81f1-4422-9342-45dfe1653639 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:07.517466 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae6de385-81f1-4422-9342-45dfe1653639 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:07.518251 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae6de385-81f1-4422-9342-45dfe1653639 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:07.577081 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-08d85325-3ba8-4f01-bdaf-ba6c25f9527c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:07.578224 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-08d85325-3ba8-4f01-bdaf-ba6c25f9527c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:07.586345 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-08d85325-3ba8-4f01-bdaf-ba6c25f9527c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:07.586783 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-08d85325-3ba8-4f01-bdaf-ba6c25f9527c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:07.587559 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-08d85325-3ba8-4f01-bdaf-ba6c25f9527c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:07.588140 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-08d85325-3ba8-4f01-bdaf-ba6c25f9527c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:07.763396 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ae6de385-81f1-4422-9342-45dfe1653639 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 24949 microversion: 2.20 time: 0.268282 Jul 22 22:15:07.764536 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 92/186] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:07 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 24949 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:07.771790 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bfe8caf0-909a-4f54-bff0-6b0d509b008f tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:07.772439 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-bfe8caf0-909a-4f54-bff0-6b0d509b008f tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:07.779146 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfe8caf0-909a-4f54-bff0-6b0d509b008f tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:07.779596 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfe8caf0-909a-4f54-bff0-6b0d509b008f tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:07.780400 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfe8caf0-909a-4f54-bff0-6b0d509b008f tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:07.780840 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfe8caf0-909a-4f54-bff0-6b0d509b008f tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:07.796921 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-bfe8caf0-909a-4f54-bff0-6b0d509b008f tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] HTTP exception thrown: Instance 73570a19-27c7-4bdc-b64c-a0c5e008ff3f could not be found. Jul 22 22:15:07.797534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bfe8caf0-909a-4f54-bff0-6b0d509b008f tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Returning 404 to user: Instance 73570a19-27c7-4bdc-b64c-a0c5e008ff3f could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:15:07.798611 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-bfe8caf0-909a-4f54-bff0-6b0d509b008f tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 404 len: 111 microversion: 2.1 time: 0.032113 Jul 22 22:15:07.799323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 93/187] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:07 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:15:07.826604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0094bf1a-5440-4469-b1c1-6b1ec69fbdbd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:07.827972 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0094bf1a-5440-4469-b1c1-6b1ec69fbdbd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:07.838444 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0094bf1a-5440-4469-b1c1-6b1ec69fbdbd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:07.839045 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0094bf1a-5440-4469-b1c1-6b1ec69fbdbd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:07.839712 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0094bf1a-5440-4469-b1c1-6b1ec69fbdbd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:07.840232 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0094bf1a-5440-4469-b1c1-6b1ec69fbdbd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:07.845687 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-08d85325-3ba8-4f01-bdaf-ba6c25f9527c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 25989 microversion: 2.1 time: 0.272116 Jul 22 22:15:07.847872 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 95/188] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:07 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 25989 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:15:08.004456 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0094bf1a-5440-4469-b1c1-6b1ec69fbdbd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:08.013708 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0094bf1a-5440-4469-b1c1-6b1ec69fbdbd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1510 microversion: 2.1 time: 0.193805 Jul 22 22:15:08.014476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 94/189] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:07 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:08.041223 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-af00b22b-3d86-41e7-ad15-67cbeb126284 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10c67547-2029-4531-8cea-2ff7fd292bdb"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:08.044720 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-af00b22b-3d86-41e7-ad15-67cbeb126284 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:08.057501 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-af00b22b-3d86-41e7-ad15-67cbeb126284 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:08.057944 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-af00b22b-3d86-41e7-ad15-67cbeb126284 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:08.058905 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-af00b22b-3d86-41e7-ad15-67cbeb126284 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:08.059490 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-af00b22b-3d86-41e7-ad15-67cbeb126284 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:08.198181 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-af00b22b-3d86-41e7-ad15-67cbeb126284 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] HTTP exception thrown: Invalid volume: volume 10c67547-2029-4531-8cea-2ff7fd292bdb is already attached to instances: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245 Jul 22 22:15:08.198789 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-af00b22b-3d86-41e7-ad15-67cbeb126284 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Returning 400 to user: Invalid volume: volume 10c67547-2029-4531-8cea-2ff7fd292bdb is already attached to instances: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245 {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:15:08.199633 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-af00b22b-3d86-41e7-ad15-67cbeb126284 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "POST /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.170846 Jul 22 22:15:08.200537 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 96/190] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:15:08 2021] POST /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4/os-volume_attachments => generated 174 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 22 22:15:08.304882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d5bfd709-398e-46e8-9c59-9e859028a88e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:08.305387 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d5bfd709-398e-46e8-9c59-9e859028a88e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:08.312514 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d5bfd709-398e-46e8-9c59-9e859028a88e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:08.312514 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d5bfd709-398e-46e8-9c59-9e859028a88e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:08.313085 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d5bfd709-398e-46e8-9c59-9e859028a88e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:08.313764 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d5bfd709-398e-46e8-9c59-9e859028a88e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:08.367229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-91047153-9ece-4d39-b593-468155b367bd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:08.368224 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-91047153-9ece-4d39-b593-468155b367bd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:08.378798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-91047153-9ece-4d39-b593-468155b367bd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:08.379852 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-91047153-9ece-4d39-b593-468155b367bd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:08.382343 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-91047153-9ece-4d39-b593-468155b367bd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:08.383151 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-91047153-9ece-4d39-b593-468155b367bd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:08.479591 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-91047153-9ece-4d39-b593-468155b367bd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:08.488489 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-91047153-9ece-4d39-b593-468155b367bd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1315 microversion: 2.1 time: 0.127585 Jul 22 22:15:08.489067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 97/191] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:08 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1315 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:08.502130 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-d5bfd709-398e-46e8-9c59-9e859028a88e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lazy-loading 'services' on Instance uuid 4d6bddb6-47da-429e-9c5d-d9e1d50b4245 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:15:08.629899 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d5bfd709-398e-46e8-9c59-9e859028a88e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "DELETE /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245/os-volume_attachments/10c67547-2029-4531-8cea-2ff7fd292bdb" status: 202 len: 0 microversion: 2.1 time: 0.328804 Jul 22 22:15:08.631470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 95/192] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:15:08 2021] DELETE /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245/os-volume_attachments/10c67547-2029-4531-8cea-2ff7fd292bdb => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:08.775343 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0b3cb38a-fc23-4349-ba21-e97db3b23dba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:08.776245 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0b3cb38a-fc23-4349-ba21-e97db3b23dba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:08.783349 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b3cb38a-fc23-4349-ba21-e97db3b23dba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:08.783806 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b3cb38a-fc23-4349-ba21-e97db3b23dba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:08.784682 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b3cb38a-fc23-4349-ba21-e97db3b23dba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:08.785152 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b3cb38a-fc23-4349-ba21-e97db3b23dba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:08.866219 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a54a97ff-63a6-4167-8982-cf0b18efe80e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:08.867768 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a54a97ff-63a6-4167-8982-cf0b18efe80e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:08.875864 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a54a97ff-63a6-4167-8982-cf0b18efe80e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:08.877076 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a54a97ff-63a6-4167-8982-cf0b18efe80e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:08.878281 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a54a97ff-63a6-4167-8982-cf0b18efe80e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:08.878729 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a54a97ff-63a6-4167-8982-cf0b18efe80e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:09.080103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0b3cb38a-fc23-4349-ba21-e97db3b23dba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 25570 microversion: 2.20 time: 0.308042 Jul 22 22:15:09.080782 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 98/193] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:08 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 25570 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:09.172128 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2bce1436-7975-4701-ba6b-07d9076a67ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:09.172868 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2bce1436-7975-4701-ba6b-07d9076a67ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:09.180066 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bce1436-7975-4701-ba6b-07d9076a67ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:09.180552 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bce1436-7975-4701-ba6b-07d9076a67ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:09.181332 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bce1436-7975-4701-ba6b-07d9076a67ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:09.181857 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bce1436-7975-4701-ba6b-07d9076a67ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:09.199604 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-2bce1436-7975-4701-ba6b-07d9076a67ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] HTTP exception thrown: Instance 73570a19-27c7-4bdc-b64c-a0c5e008ff3f could not be found. Jul 22 22:15:09.200478 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2bce1436-7975-4701-ba6b-07d9076a67ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Returning 404 to user: Instance 73570a19-27c7-4bdc-b64c-a0c5e008ff3f could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:15:09.201371 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2bce1436-7975-4701-ba6b-07d9076a67ac tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "DELETE /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 404 len: 111 microversion: 2.1 time: 0.033464 Jul 22 22:15:09.201929 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 99/194] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:15:09 2021] DELETE /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 22:15:09.212152 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-076f94e0-93ef-432f-bdcb-3d0a003c947b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:09.212997 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-076f94e0-93ef-432f-bdcb-3d0a003c947b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] [instance: 73570a19-27c7-4bdc-b64c-a0c5e008ff3f] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:09.220920 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-076f94e0-93ef-432f-bdcb-3d0a003c947b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:09.221867 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-076f94e0-93ef-432f-bdcb-3d0a003c947b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:09.222632 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-076f94e0-93ef-432f-bdcb-3d0a003c947b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:09.222730 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-076f94e0-93ef-432f-bdcb-3d0a003c947b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:09.227649 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a54a97ff-63a6-4167-8982-cf0b18efe80e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 26766 microversion: 2.1 time: 0.370939 Jul 22 22:15:09.234891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 96/195] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:08 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 26766 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:15:09.239413 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-076f94e0-93ef-432f-bdcb-3d0a003c947b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] HTTP exception thrown: Instance 73570a19-27c7-4bdc-b64c-a0c5e008ff3f could not be found. Jul 22 22:15:09.239835 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-076f94e0-93ef-432f-bdcb-3d0a003c947b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] Returning 404 to user: Instance 73570a19-27c7-4bdc-b64c-a0c5e008ff3f could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:15:09.240710 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-076f94e0-93ef-432f-bdcb-3d0a003c947b tempest-DeleteServersTestJSON-189844871 tempest-DeleteServersTestJSON-189844871-project] 10.222.0.110 "GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f" status: 404 len: 111 microversion: 2.1 time: 0.033334 Jul 22 22:15:09.241627 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 100/196] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:09 2021] GET /compute/v2.1/servers/73570a19-27c7-4bdc-b64c-a0c5e008ff3f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 22:15:09.507737 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-79596814-5c6b-4206-9d41-0706f30cd655 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:09.508479 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-79596814-5c6b-4206-9d41-0706f30cd655 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:09.516191 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79596814-5c6b-4206-9d41-0706f30cd655 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:09.516680 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79596814-5c6b-4206-9d41-0706f30cd655 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:09.518155 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79596814-5c6b-4206-9d41-0706f30cd655 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:09.518692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79596814-5c6b-4206-9d41-0706f30cd655 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:09.682591 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-79596814-5c6b-4206-9d41-0706f30cd655 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:09.692260 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-79596814-5c6b-4206-9d41-0706f30cd655 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1321 microversion: 2.1 time: 0.188407 Jul 22 22:15:09.705223 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 97/197] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:09 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:10.095669 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-dfa5b4b5-e3df-4fe9-85be-1a958f22399b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:10.097156 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-dfa5b4b5-e3df-4fe9-85be-1a958f22399b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:10.110788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dfa5b4b5-e3df-4fe9-85be-1a958f22399b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:10.112414 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dfa5b4b5-e3df-4fe9-85be-1a958f22399b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:10.114103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dfa5b4b5-e3df-4fe9-85be-1a958f22399b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:10.114993 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dfa5b4b5-e3df-4fe9-85be-1a958f22399b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:10.245852 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ae7c4151-0c74-484f-bab4-c1c2a1a554b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:10.247203 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ae7c4151-0c74-484f-bab4-c1c2a1a554b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:10.257472 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae7c4151-0c74-484f-bab4-c1c2a1a554b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:10.258267 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae7c4151-0c74-484f-bab4-c1c2a1a554b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:10.259067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae7c4151-0c74-484f-bab4-c1c2a1a554b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:10.260172 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae7c4151-0c74-484f-bab4-c1c2a1a554b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:29.287686 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ae7c4151-0c74-484f-bab4-c1c2a1a554b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 28823 microversion: 2.1 time: 19.045701 Jul 22 22:15:29.292388 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 98/198] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:10 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 28823 bytes in 19048 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:15:29.294112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1f6cb3d5-ada8-4678-a477-845881c40346 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:29.294822 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1f6cb3d5-ada8-4678-a477-845881c40346 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:29.307458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1f6cb3d5-ada8-4678-a477-845881c40346 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:29.308014 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1f6cb3d5-ada8-4678-a477-845881c40346 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:29.308794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1f6cb3d5-ada8-4678-a477-845881c40346 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:29.309234 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1f6cb3d5-ada8-4678-a477-845881c40346 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:29.346269 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-dfa5b4b5-e3df-4fe9-85be-1a958f22399b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28334 microversion: 2.20 time: 19.258501 Jul 22 22:15:29.347210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 101/199] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:10 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28334 bytes in 19261 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:29.671246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1f6cb3d5-ada8-4678-a477-845881c40346 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:29.684637 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1f6cb3d5-ada8-4678-a477-845881c40346 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1363 microversion: 2.1 time: 0.394480 Jul 22 22:15:29.686068 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 99/200] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:29 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1363 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:29.868747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1070142212", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ceb2519c-36d6-46cf-986d-f84d5cb7e8c3"}]}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:29.972067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.network.neutron [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] validate_networks() for [('ceb2519c-36d6-46cf-986d-f84d5cb7e8c3', None, None, None)] {{(pid=107498) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:15:30.060346 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-0f6d79c2-216b-4321-a13f-4a7434feb71f req-30dce034-a51b-4a7b-97cd-3f27f8854ffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cddea8-25f9-440b-86f2-dd9c49130770", "tag": "c19590f0-00b8-4111-9a00-68a6160feb39"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:30.062531 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:15:30.062531 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:15:30.076171 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-0f6d79c2-216b-4321-a13f-4a7434feb71f req-30dce034-a51b-4a7b-97cd-3f27f8854ffe service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:30.076639 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-0f6d79c2-216b-4321-a13f-4a7434feb71f req-30dce034-a51b-4a7b-97cd-3f27f8854ffe service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:30.102790 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-0f6d79c2-216b-4321-a13f-4a7434feb71f req-30dce034-a51b-4a7b-97cd-3f27f8854ffe service nova] Creating event network-changed:c19590f0-00b8-4111-9a00-68a6160feb39 for instance e8cddea8-25f9-440b-86f2-dd9c49130770 on hv-cinder-80186 Jul 22 22:15:30.119509 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-0f6d79c2-216b-4321-a13f-4a7434feb71f req-30dce034-a51b-4a7b-97cd-3f27f8854ffe service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063142 Jul 22 22:15:30.120359 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 100/201] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:15:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:15:30.301527 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-03d1dc1b-4b8b-4fd5-83c8-93fa70dad99d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:30.303405 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-03d1dc1b-4b8b-4fd5-83c8-93fa70dad99d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:30.314026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03d1dc1b-4b8b-4fd5-83c8-93fa70dad99d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:30.318165 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03d1dc1b-4b8b-4fd5-83c8-93fa70dad99d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:30.319238 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03d1dc1b-4b8b-4fd5-83c8-93fa70dad99d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:30.323516 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03d1dc1b-4b8b-4fd5-83c8-93fa70dad99d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:30.557827 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-03d1dc1b-4b8b-4fd5-83c8-93fa70dad99d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 28855 microversion: 2.1 time: 0.260246 Jul 22 22:15:30.559401 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 101/202] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:30 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 28855 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:15:30.570105 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fbd8a9fd-1b8b-41ea-9db2-96301d3b02b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:30.571829 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fbd8a9fd-1b8b-41ea-9db2-96301d3b02b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:30.580317 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbd8a9fd-1b8b-41ea-9db2-96301d3b02b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:30.581292 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbd8a9fd-1b8b-41ea-9db2-96301d3b02b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:30.582096 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbd8a9fd-1b8b-41ea-9db2-96301d3b02b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:30.583277 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbd8a9fd-1b8b-41ea-9db2-96301d3b02b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:30.834151 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fbd8a9fd-1b8b-41ea-9db2-96301d3b02b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28457 microversion: 2.20 time: 0.271527 Jul 22 22:15:30.838340 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 102/203] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:30 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28457 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:30.842883 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-04b3d225-d5ce-4262-b3e1-e7217c605f47 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:30.843957 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-04b3d225-d5ce-4262-b3e1-e7217c605f47 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:30.854446 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-04b3d225-d5ce-4262-b3e1-e7217c605f47 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:30.854954 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-04b3d225-d5ce-4262-b3e1-e7217c605f47 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:30.855742 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-04b3d225-d5ce-4262-b3e1-e7217c605f47 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:30.856164 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-04b3d225-d5ce-4262-b3e1-e7217c605f47 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:30.949087 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Flavor limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:15:30.949612 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Image limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:15:30.949979 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Flavor pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:15:30.950389 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Image pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:15:30.951000 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:15:30.967018 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:30.967854 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:30.968788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:30.969798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:31.018735 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Getting quotas for project 86fc8f5aa1e84d0da9f9e144ec46978a. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:15:31.024181 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Getting quotas for user 0d31eb0bf8e34ae78249d46cc282c711 and project 86fc8f5aa1e84d0da9f9e144ec46978a. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:15:31.039457 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Going to run 1 instances... {{(pid=107498) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:15:31.042703 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:15:31.140300 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b106d18c-eafe-4dc3-ac47-63cb86f00a6a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.791721 Jul 22 22:15:31.150640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 102/204] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:15:29 2021] POST /compute/v2.1/servers => generated 385 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:15:31.155411 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-41edb03c-34d0-4983-bd8e-54163fab6958 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:31.156030 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-41edb03c-34d0-4983-bd8e-54163fab6958 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:31.246474 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-04b3d225-d5ce-4262-b3e1-e7217c605f47 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:31.256259 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-04b3d225-d5ce-4262-b3e1-e7217c605f47 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1363 microversion: 2.1 time: 0.419198 Jul 22 22:15:31.258007 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 103/205] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:30 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1363 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:31.296592 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-41edb03c-34d0-4983-bd8e-54163fab6958 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:31.303715 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-41edb03c-34d0-4983-bd8e-54163fab6958 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1226 microversion: 2.1 time: 0.151916 Jul 22 22:15:31.306478 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 103/206] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:31 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:31.373824 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1589349087", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "networks": [{"uuid": "2efa360b-cc3d-49e4-a8a0-1edcaa3e915e"}]}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:31.473238 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.network.neutron [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] validate_networks() for [('2efa360b-cc3d-49e4-a8a0-1edcaa3e915e', None, None, None)] {{(pid=107499) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:15:31.495284 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-471880440", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ceb2519c-36d6-46cf-986d-f84d5cb7e8c3"}]}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:31.609488 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.network.neutron [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] validate_networks() for [('ceb2519c-36d6-46cf-986d-f84d5cb7e8c3', None, None, None)] {{(pid=107498) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:15:32.401001 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Flavor limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:15:32.401542 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Image limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:15:32.401867 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Flavor pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:15:32.402266 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Image pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:15:32.402666 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:15:32.413202 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:32.413652 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:32.414507 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:32.414939 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:32.431573 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Getting quotas for project 71bffb8e6c93437cb3fdbc82d8300750. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:15:32.435891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Getting quotas for user 7438b1d834bd4e5f91ae4169e6b3a543 and project 71bffb8e6c93437cb3fdbc82d8300750. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:15:32.449385 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Going to run 1 instances... {{(pid=107499) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:15:32.451869 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107499) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:15:32.500379 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e71d1dc5-49bb-4099-896c-b9ac1c8866c4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 1.135834 Jul 22 22:15:32.506250 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 104/207] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:15:31 2021] POST /compute/v2.1/servers => generated 382 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:15:32.507091 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-58b015a4-86f5-40f7-b101-716910177cc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:32.508339 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-58b015a4-86f5-40f7-b101-716910177cc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:32.514876 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-58b015a4-86f5-40f7-b101-716910177cc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:32.515680 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-58b015a4-86f5-40f7-b101-716910177cc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:32.517314 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-58b015a4-86f5-40f7-b101-716910177cc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:32.517862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-58b015a4-86f5-40f7-b101-716910177cc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:32.698956 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-58b015a4-86f5-40f7-b101-716910177cc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29111 microversion: 2.1 time: 0.196024 Jul 22 22:15:32.700337 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 105/208] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:32 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29111 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:32.712987 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3177ad9d-1d4b-46a7-84c9-15bf4128d81e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:32.716310 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3177ad9d-1d4b-46a7-84c9-15bf4128d81e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:32.740107 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3177ad9d-1d4b-46a7-84c9-15bf4128d81e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:32.740859 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3177ad9d-1d4b-46a7-84c9-15bf4128d81e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:32.741813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3177ad9d-1d4b-46a7-84c9-15bf4128d81e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:32.742403 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3177ad9d-1d4b-46a7-84c9-15bf4128d81e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:32.863636 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Flavor limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:15:32.864424 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Image limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:15:32.865032 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Flavor pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:15:32.865654 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Image pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:15:32.866191 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:15:32.907423 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:32.908503 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:32.910132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:32.910799 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:32.952805 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3177ad9d-1d4b-46a7-84c9-15bf4128d81e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28619 microversion: 2.20 time: 0.245873 Jul 22 22:15:32.957763 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 106/209] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:32 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28619 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:32.967089 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0cfde942-3558-4681-a8aa-28790109041f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:32.967089 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0cfde942-3558-4681-a8aa-28790109041f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:32.971601 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Getting quotas for project 86fc8f5aa1e84d0da9f9e144ec46978a. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:15:32.977960 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Getting quotas for user 0d31eb0bf8e34ae78249d46cc282c711 and project 86fc8f5aa1e84d0da9f9e144ec46978a. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:15:32.985037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0cfde942-3558-4681-a8aa-28790109041f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:32.985779 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0cfde942-3558-4681-a8aa-28790109041f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:32.986704 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0cfde942-3558-4681-a8aa-28790109041f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:32.987141 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0cfde942-3558-4681-a8aa-28790109041f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:32.994876 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Going to run 1 instances... {{(pid=107498) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:15:32.999057 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:15:33.107589 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6d5ca59a-dcd1-49af-94dd-b5b153bdebac tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 385 microversion: 2.1 time: 1.613107 Jul 22 22:15:33.112497 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 104/210] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:15:31 2021] POST /compute/v2.1/servers => generated 385 bytes in 1622 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:15:33.127512 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5d3fea82-50e1-40f2-b1d5-cfce8bf59ece tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:33.129515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5d3fea82-50e1-40f2-b1d5-cfce8bf59ece tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:33.153420 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5d3fea82-50e1-40f2-b1d5-cfce8bf59ece tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:33.153986 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5d3fea82-50e1-40f2-b1d5-cfce8bf59ece tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:33.154910 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5d3fea82-50e1-40f2-b1d5-cfce8bf59ece tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:33.155451 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5d3fea82-50e1-40f2-b1d5-cfce8bf59ece tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:33.262268 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0cfde942-3558-4681-a8aa-28790109041f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:33.270666 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0cfde942-3558-4681-a8aa-28790109041f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1363 microversion: 2.1 time: 0.310809 Jul 22 22:15:33.271256 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 107/211] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:32 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:33.275791 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c6e0538a-af98-4a21-bfb4-adc0b4109b40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:33.291208 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c6e0538a-af98-4a21-bfb4-adc0b4109b40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:33.401904 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c6e0538a-af98-4a21-bfb4-adc0b4109b40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:33.422322 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c6e0538a-af98-4a21-bfb4-adc0b4109b40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1225 microversion: 2.1 time: 0.149488 Jul 22 22:15:33.423466 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 108/212] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:33 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1225 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:33.451684 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5d3fea82-50e1-40f2-b1d5-cfce8bf59ece tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:33.467137 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5d3fea82-50e1-40f2-b1d5-cfce8bf59ece tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1226 microversion: 2.1 time: 0.352394 Jul 22 22:15:33.467696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 105/213] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:33 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1226 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:33.713775 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-20218466-6323-4e84-b93a-8912a8699a2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:33.715072 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-20218466-6323-4e84-b93a-8912a8699a2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:33.722997 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20218466-6323-4e84-b93a-8912a8699a2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:33.723683 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20218466-6323-4e84-b93a-8912a8699a2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:33.724962 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20218466-6323-4e84-b93a-8912a8699a2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:33.725593 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20218466-6323-4e84-b93a-8912a8699a2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:33.965072 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b580a840-d385-4492-93b2-c7f45af11b19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:33.966053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b580a840-d385-4492-93b2-c7f45af11b19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:33.972596 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b580a840-d385-4492-93b2-c7f45af11b19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:33.973041 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b580a840-d385-4492-93b2-c7f45af11b19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:33.973823 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b580a840-d385-4492-93b2-c7f45af11b19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:33.974249 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b580a840-d385-4492-93b2-c7f45af11b19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:33.982568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-20218466-6323-4e84-b93a-8912a8699a2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29111 microversion: 2.1 time: 0.273154 Jul 22 22:15:33.983951 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 109/214] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:33 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29111 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:34.102209 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b580a840-d385-4492-93b2-c7f45af11b19 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28619 microversion: 2.20 time: 0.140741 Jul 22 22:15:34.106123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 106/215] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:33 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28619 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:15:34.289033 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1ca10ac0-0fc2-4518-82c6-b66d1750e744 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:34.293169 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1ca10ac0-0fc2-4518-82c6-b66d1750e744 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:34.300638 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1ca10ac0-0fc2-4518-82c6-b66d1750e744 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:34.301089 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1ca10ac0-0fc2-4518-82c6-b66d1750e744 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:34.301862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1ca10ac0-0fc2-4518-82c6-b66d1750e744 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:34.302450 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1ca10ac0-0fc2-4518-82c6-b66d1750e744 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:34.442926 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0cad921b-c9fa-457f-8a42-10a216669810 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:34.443634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0cad921b-c9fa-457f-8a42-10a216669810 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:34.458854 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cad921b-c9fa-457f-8a42-10a216669810 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:34.459305 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cad921b-c9fa-457f-8a42-10a216669810 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:34.460084 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cad921b-c9fa-457f-8a42-10a216669810 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:34.460552 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cad921b-c9fa-457f-8a42-10a216669810 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:34.501516 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1ca10ac0-0fc2-4518-82c6-b66d1750e744 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:34.513034 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1ca10ac0-0fc2-4518-82c6-b66d1750e744 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1363 microversion: 2.1 time: 0.227918 Jul 22 22:15:34.513604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 110/216] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:34 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:34.518812 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-be20c65c-c528-4878-a341-796ce59bc4f9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:34.519415 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-be20c65c-c528-4878-a341-796ce59bc4f9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:34.525412 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-be20c65c-c528-4878-a341-796ce59bc4f9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:34.526085 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-be20c65c-c528-4878-a341-796ce59bc4f9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:34.527235 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-be20c65c-c528-4878-a341-796ce59bc4f9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:34.527870 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-be20c65c-c528-4878-a341-796ce59bc4f9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:34.620230 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-be20c65c-c528-4878-a341-796ce59bc4f9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:34.628899 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0cad921b-c9fa-457f-8a42-10a216669810 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:34.631731 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-be20c65c-c528-4878-a341-796ce59bc4f9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1274 microversion: 2.1 time: 0.116870 Jul 22 22:15:34.632782 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 111/217] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:34 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1274 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:34.648801 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0cad921b-c9fa-457f-8a42-10a216669810 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1221 microversion: 2.1 time: 0.211984 Jul 22 22:15:34.649654 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 107/218] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:34 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1221 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:34.999033 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1678e67f-1ad2-41f9-b393-f8e15edc5c3a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:35.000195 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1678e67f-1ad2-41f9-b393-f8e15edc5c3a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:35.007935 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1678e67f-1ad2-41f9-b393-f8e15edc5c3a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:35.008577 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1678e67f-1ad2-41f9-b393-f8e15edc5c3a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:35.009520 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1678e67f-1ad2-41f9-b393-f8e15edc5c3a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:35.010109 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1678e67f-1ad2-41f9-b393-f8e15edc5c3a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:35.114748 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a4b2cca8-cb0d-4f6e-ba45-bac8124e9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:35.115949 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a4b2cca8-cb0d-4f6e-ba45-bac8124e9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:35.121664 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a4b2cca8-cb0d-4f6e-ba45-bac8124e9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:35.122116 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a4b2cca8-cb0d-4f6e-ba45-bac8124e9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:35.125097 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a4b2cca8-cb0d-4f6e-ba45-bac8124e9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:35.126423 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a4b2cca8-cb0d-4f6e-ba45-bac8124e9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:35.201887 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1678e67f-1ad2-41f9-b393-f8e15edc5c3a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29277 microversion: 2.1 time: 0.210486 Jul 22 22:15:35.203013 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 112/219] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:34 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:15:35.378525 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a4b2cca8-cb0d-4f6e-ba45-bac8124e9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28786 microversion: 2.20 time: 0.268366 Jul 22 22:15:35.379038 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 108/220] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:35 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28786 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:15:35.537407 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-eab0b7df-8edf-4ba5-979c-1ea246d5ba69 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:35.540834 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-eab0b7df-8edf-4ba5-979c-1ea246d5ba69 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:35.552670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eab0b7df-8edf-4ba5-979c-1ea246d5ba69 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:35.553353 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eab0b7df-8edf-4ba5-979c-1ea246d5ba69 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:35.554302 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eab0b7df-8edf-4ba5-979c-1ea246d5ba69 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:35.554882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eab0b7df-8edf-4ba5-979c-1ea246d5ba69 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:35.655084 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bb75556b-4264-4620-a73d-c62a1b640cc0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:35.655789 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bb75556b-4264-4620-a73d-c62a1b640cc0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:35.665205 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bb75556b-4264-4620-a73d-c62a1b640cc0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:35.665943 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bb75556b-4264-4620-a73d-c62a1b640cc0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:35.667121 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bb75556b-4264-4620-a73d-c62a1b640cc0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:35.668150 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bb75556b-4264-4620-a73d-c62a1b640cc0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:35.770598 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bb75556b-4264-4620-a73d-c62a1b640cc0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:35.779456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bb75556b-4264-4620-a73d-c62a1b640cc0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1282 microversion: 2.1 time: 0.133227 Jul 22 22:15:35.794820 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 109/221] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:35 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:35.794820 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-73bfd13f-ee2a-4c11-9240-2c449fca8996 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:35.794820 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-73bfd13f-ee2a-4c11-9240-2c449fca8996 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:35.803302 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-73bfd13f-ee2a-4c11-9240-2c449fca8996 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:35.804304 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-73bfd13f-ee2a-4c11-9240-2c449fca8996 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:35.805819 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-73bfd13f-ee2a-4c11-9240-2c449fca8996 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:35.806264 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-73bfd13f-ee2a-4c11-9240-2c449fca8996 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:35.819439 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-eab0b7df-8edf-4ba5-979c-1ea246d5ba69 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:35.830268 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-eab0b7df-8edf-4ba5-979c-1ea246d5ba69 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1363 microversion: 2.1 time: 0.300166 Jul 22 22:15:35.832902 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 113/222] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:35 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:35.906143 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-73bfd13f-ee2a-4c11-9240-2c449fca8996 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:35.918398 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-73bfd13f-ee2a-4c11-9240-2c449fca8996 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1277 microversion: 2.1 time: 0.132105 Jul 22 22:15:35.920527 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 110/223] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:35 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1277 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:35.925774 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1678572890", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "networks": [{"uuid": "73f6a462-6d96-4362-8ffe-cbb77da56019"}]}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:36.010747 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.network.neutron [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] validate_networks() for [('73f6a462-6d96-4362-8ffe-cbb77da56019', None, None, None)] {{(pid=107499) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:15:36.216845 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-42a29696-cfad-4a11-9ec2-72d27ee841df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:36.219457 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-42a29696-cfad-4a11-9ec2-72d27ee841df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:36.227597 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a29696-cfad-4a11-9ec2-72d27ee841df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:36.228393 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a29696-cfad-4a11-9ec2-72d27ee841df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:36.229345 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a29696-cfad-4a11-9ec2-72d27ee841df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:36.229921 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a29696-cfad-4a11-9ec2-72d27ee841df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:36.488943 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-42a29696-cfad-4a11-9ec2-72d27ee841df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29277 microversion: 2.1 time: 0.277494 Jul 22 22:15:36.489764 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 111/224] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:36 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29277 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:36.495125 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-f4c57990-34f4-4d96-8923-7f8474bcf639 req-7676839f-4b82-4cd8-9fa8-3b63c14cd4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae", "tag": "4cae57e3-646c-477f-9363-d0fd4b8135a7"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:36.496621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:15:36.496621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:15:36.504917 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-f4c57990-34f4-4d96-8923-7f8474bcf639 req-7676839f-4b82-4cd8-9fa8-3b63c14cd4aa service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:36.505430 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-f4c57990-34f4-4d96-8923-7f8474bcf639 req-7676839f-4b82-4cd8-9fa8-3b63c14cd4aa service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:36.517951 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-f4c57990-34f4-4d96-8923-7f8474bcf639 req-7676839f-4b82-4cd8-9fa8-3b63c14cd4aa service nova] Creating event network-changed:4cae57e3-646c-477f-9363-d0fd4b8135a7 for instance c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae on hv-cinder-80186 Jul 22 22:15:36.523738 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-f4c57990-34f4-4d96-8923-7f8474bcf639 req-7676839f-4b82-4cd8-9fa8-3b63c14cd4aa service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032405 Jul 22 22:15:36.524795 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 112/225] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:15:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:15:36.531173 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-df8bb14c-91f4-42fe-90ea-f2b3c33d438b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:36.532188 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-df8bb14c-91f4-42fe-90ea-f2b3c33d438b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:36.539320 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-df8bb14c-91f4-42fe-90ea-f2b3c33d438b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:36.540040 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-df8bb14c-91f4-42fe-90ea-f2b3c33d438b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:36.541008 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-df8bb14c-91f4-42fe-90ea-f2b3c33d438b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:36.541605 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-df8bb14c-91f4-42fe-90ea-f2b3c33d438b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:36.704123 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Flavor limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:15:36.706124 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Image limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:15:36.706605 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Flavor pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:15:36.707178 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Image pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:15:36.707631 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:15:36.717582 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:36.717972 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:36.718760 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:36.719272 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:36.727800 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-df8bb14c-91f4-42fe-90ea-f2b3c33d438b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28786 microversion: 2.20 time: 0.201363 Jul 22 22:15:36.732049 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 113/226] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:36 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28786 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:36.739525 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Getting quotas for project 26d903c452a64781bf8cb22c894f6ddd. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:15:36.744031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Getting quotas for user 15dafba37aa544fc88c36284ebab3a9d and project 26d903c452a64781bf8cb22c894f6ddd. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:15:36.759630 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Going to run 1 instances... {{(pid=107499) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:15:36.762310 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107499) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:15:36.803475 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c92ee89c-be3a-4649-af97-b471c0b26cf7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:36.804674 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c92ee89c-be3a-4649-af97-b471c0b26cf7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:36.811697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c92ee89c-be3a-4649-af97-b471c0b26cf7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:36.812423 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c92ee89c-be3a-4649-af97-b471c0b26cf7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:36.814132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c92ee89c-be3a-4649-af97-b471c0b26cf7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:36.814911 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c92ee89c-be3a-4649-af97-b471c0b26cf7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:36.851749 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6926f67c-73db-4df2-b780-e31a875de76a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.927421 Jul 22 22:15:36.853071 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 114/227] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:15:35 2021] POST /compute/v2.1/servers => generated 382 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 22 22:15:36.865240 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5a480ea5-ab7c-4f33-b454-92471089a3cc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:36.866295 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5a480ea5-ab7c-4f33-b454-92471089a3cc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:36.877731 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a480ea5-ab7c-4f33-b454-92471089a3cc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:36.878433 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a480ea5-ab7c-4f33-b454-92471089a3cc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:36.879564 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a480ea5-ab7c-4f33-b454-92471089a3cc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:36.880236 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a480ea5-ab7c-4f33-b454-92471089a3cc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:37.138348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5a480ea5-ab7c-4f33-b454-92471089a3cc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:37.151697 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5a480ea5-ab7c-4f33-b454-92471089a3cc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1363 microversion: 2.1 time: 0.296977 Jul 22 22:15:37.152473 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 115/228] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:36 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1363 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:37.178581 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-63a42b88-732f-434d-8808-e1d476669daa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:37.179555 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-63a42b88-732f-434d-8808-e1d476669daa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:37.268966 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c92ee89c-be3a-4649-af97-b471c0b26cf7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:37.277771 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-63a42b88-732f-434d-8808-e1d476669daa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:37.287937 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-63a42b88-732f-434d-8808-e1d476669daa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1218 microversion: 2.1 time: 0.120639 Jul 22 22:15:37.289009 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 116/229] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:37 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:37.294059 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-25f9d8f0-b165-46e7-9eab-1ce4c1465f8d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:37.294664 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-25f9d8f0-b165-46e7-9eab-1ce4c1465f8d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:37.300975 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c92ee89c-be3a-4649-af97-b471c0b26cf7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.489926 Jul 22 22:15:37.302356 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-25f9d8f0-b165-46e7-9eab-1ce4c1465f8d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:37.303046 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-25f9d8f0-b165-46e7-9eab-1ce4c1465f8d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:37.312155 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 114/230] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:36 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:37.315177 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-25f9d8f0-b165-46e7-9eab-1ce4c1465f8d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:37.315820 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-25f9d8f0-b165-46e7-9eab-1ce4c1465f8d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:37.450551 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-25f9d8f0-b165-46e7-9eab-1ce4c1465f8d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:37.462632 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-25f9d8f0-b165-46e7-9eab-1ce4c1465f8d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1283 microversion: 2.1 time: 0.172232 Jul 22 22:15:37.473016 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 117/231] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:37 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1283 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:37.502814 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-aa486d3c-dd8e-407d-bc18-c170f7cbb16d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:37.504153 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-aa486d3c-dd8e-407d-bc18-c170f7cbb16d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:37.510096 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-aa486d3c-dd8e-407d-bc18-c170f7cbb16d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:37.510785 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-aa486d3c-dd8e-407d-bc18-c170f7cbb16d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:37.511776 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-aa486d3c-dd8e-407d-bc18-c170f7cbb16d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:37.512384 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-aa486d3c-dd8e-407d-bc18-c170f7cbb16d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:37.739662 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a8bbd4bd-18e9-452b-abb4-3eb94bbd370f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:37.740749 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a8bbd4bd-18e9-452b-abb4-3eb94bbd370f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:37.748576 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-aa486d3c-dd8e-407d-bc18-c170f7cbb16d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29277 microversion: 2.1 time: 0.249151 Jul 22 22:15:37.754088 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a8bbd4bd-18e9-452b-abb4-3eb94bbd370f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:37.755569 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 115/232] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:37 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29277 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:37.762067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a8bbd4bd-18e9-452b-abb4-3eb94bbd370f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:37.762943 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a8bbd4bd-18e9-452b-abb4-3eb94bbd370f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:37.763454 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a8bbd4bd-18e9-452b-abb4-3eb94bbd370f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:37.995554 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a8bbd4bd-18e9-452b-abb4-3eb94bbd370f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28786 microversion: 2.20 time: 0.258467 Jul 22 22:15:37.997725 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 118/233] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:37 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28786 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:15:38.079475 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-bc0fe5aa-4078-44e0-96a0-c3646ff63a16 req-4a101fcc-1486-4e04-90b7-4fab740055a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fc8f297-285c-45e7-912f-a3f64a0d4e9b", "tag": "254ffb11-410d-4f28-ab52-4f5ed744c1df"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:38.081243 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:15:38.081243 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:15:38.100143 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-bc0fe5aa-4078-44e0-96a0-c3646ff63a16 req-4a101fcc-1486-4e04-90b7-4fab740055a0 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:38.100888 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-bc0fe5aa-4078-44e0-96a0-c3646ff63a16 req-4a101fcc-1486-4e04-90b7-4fab740055a0 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:38.136696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-bc0fe5aa-4078-44e0-96a0-c3646ff63a16 req-4a101fcc-1486-4e04-90b7-4fab740055a0 service nova] Creating event network-changed:254ffb11-410d-4f28-ab52-4f5ed744c1df for instance 4fc8f297-285c-45e7-912f-a3f64a0d4e9b on hv-cinder-80186 Jul 22 22:15:38.136696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-bc0fe5aa-4078-44e0-96a0-c3646ff63a16 req-4a101fcc-1486-4e04-90b7-4fab740055a0 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057202 Jul 22 22:15:38.136696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 116/234] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:15:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:15:38.171595 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ea1819d6-dd2d-4ec7-badf-713e7adb13a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:38.172520 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ea1819d6-dd2d-4ec7-badf-713e7adb13a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:38.180386 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea1819d6-dd2d-4ec7-badf-713e7adb13a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:38.180839 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea1819d6-dd2d-4ec7-badf-713e7adb13a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:38.181614 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea1819d6-dd2d-4ec7-badf-713e7adb13a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:38.182048 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea1819d6-dd2d-4ec7-badf-713e7adb13a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:38.305700 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4d78d8d4-7e39-4a8f-9b9e-85644860f2dc tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:38.306514 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4d78d8d4-7e39-4a8f-9b9e-85644860f2dc tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:38.314447 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d78d8d4-7e39-4a8f-9b9e-85644860f2dc tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:38.315411 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d78d8d4-7e39-4a8f-9b9e-85644860f2dc tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:38.315948 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d78d8d4-7e39-4a8f-9b9e-85644860f2dc tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:38.316633 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d78d8d4-7e39-4a8f-9b9e-85644860f2dc tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:38.381510 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ea1819d6-dd2d-4ec7-badf-713e7adb13a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:38.388869 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ea1819d6-dd2d-4ec7-badf-713e7adb13a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1363 microversion: 2.1 time: 0.221675 Jul 22 22:15:38.389439 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 119/235] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:38 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:38.394082 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-08b3233e-ab1a-4577-b0fb-9ebf8ff6c2e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:38.394901 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-08b3233e-ab1a-4577-b0fb-9ebf8ff6c2e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:38.401165 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-08b3233e-ab1a-4577-b0fb-9ebf8ff6c2e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:38.401613 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-08b3233e-ab1a-4577-b0fb-9ebf8ff6c2e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:38.402394 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-08b3233e-ab1a-4577-b0fb-9ebf8ff6c2e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:38.402825 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-08b3233e-ab1a-4577-b0fb-9ebf8ff6c2e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:38.420847 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4d78d8d4-7e39-4a8f-9b9e-85644860f2dc tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:38.432547 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4d78d8d4-7e39-4a8f-9b9e-85644860f2dc tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1270 microversion: 2.1 time: 0.130872 Jul 22 22:15:38.436514 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 117/236] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:38 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:38.481766 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7c5020a8-18c6-4ab7-93fb-54073189823b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:38.482724 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7c5020a8-18c6-4ab7-93fb-54073189823b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:38.492441 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7c5020a8-18c6-4ab7-93fb-54073189823b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:38.493152 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7c5020a8-18c6-4ab7-93fb-54073189823b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:38.494211 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7c5020a8-18c6-4ab7-93fb-54073189823b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:38.494561 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7c5020a8-18c6-4ab7-93fb-54073189823b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:38.692712 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-08b3233e-ab1a-4577-b0fb-9ebf8ff6c2e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:38.700644 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-08b3233e-ab1a-4577-b0fb-9ebf8ff6c2e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.309941 Jul 22 22:15:38.701616 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 120/237] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:38 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:38.762502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-54c9aefb-63ac-4db0-843d-4ed324b0117f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:38.763461 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-54c9aefb-63ac-4db0-843d-4ed324b0117f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:38.770410 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54c9aefb-63ac-4db0-843d-4ed324b0117f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:38.770937 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54c9aefb-63ac-4db0-843d-4ed324b0117f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:38.771963 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54c9aefb-63ac-4db0-843d-4ed324b0117f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:38.772571 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54c9aefb-63ac-4db0-843d-4ed324b0117f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:39.090049 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7c5020a8-18c6-4ab7-93fb-54073189823b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:39.097906 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7c5020a8-18c6-4ab7-93fb-54073189823b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.620753 Jul 22 22:15:39.098555 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 118/238] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:38 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:39.103438 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5b6e390f-d0b7-4f7b-95d7-f28ac57a6c16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:39.104450 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5b6e390f-d0b7-4f7b-95d7-f28ac57a6c16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:39.110670 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5b6e390f-d0b7-4f7b-95d7-f28ac57a6c16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:39.116846 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5b6e390f-d0b7-4f7b-95d7-f28ac57a6c16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:39.117636 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5b6e390f-d0b7-4f7b-95d7-f28ac57a6c16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:39.118085 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5b6e390f-d0b7-4f7b-95d7-f28ac57a6c16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:39.233533 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-54c9aefb-63ac-4db0-843d-4ed324b0117f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29277 microversion: 2.1 time: 0.473886 Jul 22 22:15:39.240030 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 121/239] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:38 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29277 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:39.337651 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5b6e390f-d0b7-4f7b-95d7-f28ac57a6c16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28786 microversion: 2.20 time: 0.237670 Jul 22 22:15:39.339823 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 119/240] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:39 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28786 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:39.407552 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5d494399-9563-45df-9442-c172c46add0f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:39.416460 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5d494399-9563-45df-9442-c172c46add0f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:39.439474 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5d494399-9563-45df-9442-c172c46add0f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:39.441640 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5d494399-9563-45df-9442-c172c46add0f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:39.445447 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5d494399-9563-45df-9442-c172c46add0f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:39.446524 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5d494399-9563-45df-9442-c172c46add0f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:39.454937 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7a7a5ee6-f9b9-4c4d-8222-297c9d498b2e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:39.455660 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7a7a5ee6-f9b9-4c4d-8222-297c9d498b2e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:39.487410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a7a5ee6-f9b9-4c4d-8222-297c9d498b2e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:39.488120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a7a5ee6-f9b9-4c4d-8222-297c9d498b2e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:39.493461 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a7a5ee6-f9b9-4c4d-8222-297c9d498b2e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:39.495463 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a7a5ee6-f9b9-4c4d-8222-297c9d498b2e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:39.662270 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7a7a5ee6-f9b9-4c4d-8222-297c9d498b2e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:39.676505 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7a7a5ee6-f9b9-4c4d-8222-297c9d498b2e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1276 microversion: 2.1 time: 0.223994 Jul 22 22:15:39.677478 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 120/241] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:39 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:39.684167 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-a9dc748b-97be-4de8-bbba-2b6e210cc444 req-dc1d1f1e-a35c-496c-8144-6e42a185093f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b32a316-01f1-4ac2-9c15-708742d4afac", "tag": "78cc8d65-ba06-4a10-a7de-a5a8599859dd"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:39.686033 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:15:39.686033 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:15:39.695811 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-a9dc748b-97be-4de8-bbba-2b6e210cc444 req-dc1d1f1e-a35c-496c-8144-6e42a185093f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:39.696677 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-a9dc748b-97be-4de8-bbba-2b6e210cc444 req-dc1d1f1e-a35c-496c-8144-6e42a185093f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:39.711332 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-a9dc748b-97be-4de8-bbba-2b6e210cc444 req-dc1d1f1e-a35c-496c-8144-6e42a185093f service nova] Creating event network-changed:78cc8d65-ba06-4a10-a7de-a5a8599859dd for instance 2b32a316-01f1-4ac2-9c15-708742d4afac on hv-cinder-80186 Jul 22 22:15:39.717498 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-a9dc748b-97be-4de8-bbba-2b6e210cc444 req-dc1d1f1e-a35c-496c-8144-6e42a185093f service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038404 Jul 22 22:15:39.723537 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 121/242] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:15:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:15:39.731612 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5591a26c-7a42-48f8-971d-854074b005f8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:39.732824 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5591a26c-7a42-48f8-971d-854074b005f8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:39.741155 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5591a26c-7a42-48f8-971d-854074b005f8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:39.741781 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5591a26c-7a42-48f8-971d-854074b005f8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:39.742891 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5591a26c-7a42-48f8-971d-854074b005f8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:39.743340 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5591a26c-7a42-48f8-971d-854074b005f8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:39.983493 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5591a26c-7a42-48f8-971d-854074b005f8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:39.991884 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5591a26c-7a42-48f8-971d-854074b005f8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.266601 Jul 22 22:15:39.992503 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 122/243] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:39 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:39.997585 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-b9179e43-1795-491c-ab59-62c849a66d2f req-8a2c12e2-02fa-4325-ac83-0f2bf5bbbb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cddea8-25f9-440b-86f2-dd9c49130770", "name": "network-vif-plugged", "status": "completed", "tag": "c19590f0-00b8-4111-9a00-68a6160feb39"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:40.000260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:15:40.000260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:15:40.008032 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-b9179e43-1795-491c-ab59-62c849a66d2f req-8a2c12e2-02fa-4325-ac83-0f2bf5bbbb0b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:40.008508 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-b9179e43-1795-491c-ab59-62c849a66d2f req-8a2c12e2-02fa-4325-ac83-0f2bf5bbbb0b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:40.021155 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-b9179e43-1795-491c-ab59-62c849a66d2f req-8a2c12e2-02fa-4325-ac83-0f2bf5bbbb0b service nova] Creating event network-vif-plugged:c19590f0-00b8-4111-9a00-68a6160feb39 for instance e8cddea8-25f9-440b-86f2-dd9c49130770 on hv-cinder-80186 Jul 22 22:15:40.026097 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-b9179e43-1795-491c-ab59-62c849a66d2f req-8a2c12e2-02fa-4325-ac83-0f2bf5bbbb0b service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032185 Jul 22 22:15:40.028364 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 123/244] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:15:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:15:40.116352 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b7512beb-95c8-4809-8f3f-7df816264612 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:40.117001 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b7512beb-95c8-4809-8f3f-7df816264612 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:40.123460 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b7512beb-95c8-4809-8f3f-7df816264612 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:40.123919 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b7512beb-95c8-4809-8f3f-7df816264612 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:40.124901 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b7512beb-95c8-4809-8f3f-7df816264612 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:40.125883 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b7512beb-95c8-4809-8f3f-7df816264612 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:40.225369 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5d494399-9563-45df-9442-c172c46add0f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:40.234065 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5d494399-9563-45df-9442-c172c46add0f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1363 microversion: 2.1 time: 0.831336 Jul 22 22:15:40.235200 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 122/245] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:39 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1363 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:40.250992 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-dbb24044-f9df-42c3-abbb-4f5cbe0885f9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:40.252465 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-dbb24044-f9df-42c3-abbb-4f5cbe0885f9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:40.258824 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dbb24044-f9df-42c3-abbb-4f5cbe0885f9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:40.259276 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dbb24044-f9df-42c3-abbb-4f5cbe0885f9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:40.260051 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dbb24044-f9df-42c3-abbb-4f5cbe0885f9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:40.260527 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dbb24044-f9df-42c3-abbb-4f5cbe0885f9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:40.412490 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b7512beb-95c8-4809-8f3f-7df816264612 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:40.436200 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b7512beb-95c8-4809-8f3f-7df816264612 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.320037 Jul 22 22:15:40.437890 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 124/246] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:40 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:40.444420 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fff36024-48c4-41b5-b69a-f175df7964e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:40.445642 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fff36024-48c4-41b5-b69a-f175df7964e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:40.451151 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-dbb24044-f9df-42c3-abbb-4f5cbe0885f9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29277 microversion: 2.1 time: 0.204331 Jul 22 22:15:40.452988 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 123/247] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:40 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:40.453315 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fff36024-48c4-41b5-b69a-f175df7964e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:40.454371 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fff36024-48c4-41b5-b69a-f175df7964e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:40.456470 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fff36024-48c4-41b5-b69a-f175df7964e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:40.457258 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fff36024-48c4-41b5-b69a-f175df7964e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:40.695655 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2f3405dd-dca5-4a40-9269-74fd8bc97752 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:40.701858 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2f3405dd-dca5-4a40-9269-74fd8bc97752 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:40.710335 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2f3405dd-dca5-4a40-9269-74fd8bc97752 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:40.710954 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2f3405dd-dca5-4a40-9269-74fd8bc97752 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:40.711908 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2f3405dd-dca5-4a40-9269-74fd8bc97752 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:40.712386 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2f3405dd-dca5-4a40-9269-74fd8bc97752 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:40.864007 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2f3405dd-dca5-4a40-9269-74fd8bc97752 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:40.871147 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2f3405dd-dca5-4a40-9269-74fd8bc97752 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.180433 Jul 22 22:15:40.871701 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 124/248] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:40 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:41.008510 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e3b2998a-a2f3-4829-8fac-2244b1110cc3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:41.009115 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e3b2998a-a2f3-4829-8fac-2244b1110cc3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:41.015097 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e3b2998a-a2f3-4829-8fac-2244b1110cc3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:41.015542 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e3b2998a-a2f3-4829-8fac-2244b1110cc3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:41.016518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e3b2998a-a2f3-4829-8fac-2244b1110cc3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:41.016904 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e3b2998a-a2f3-4829-8fac-2244b1110cc3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:41.157872 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e3b2998a-a2f3-4829-8fac-2244b1110cc3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:41.165493 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e3b2998a-a2f3-4829-8fac-2244b1110cc3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.160630 Jul 22 22:15:41.166057 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 125/249] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:41 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:41.252190 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f3b7114b-73fd-4ae3-9673-3f20d235e0c3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:41.252837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f3b7114b-73fd-4ae3-9673-3f20d235e0c3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:41.258411 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f3b7114b-73fd-4ae3-9673-3f20d235e0c3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:41.258848 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f3b7114b-73fd-4ae3-9673-3f20d235e0c3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:41.259596 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f3b7114b-73fd-4ae3-9673-3f20d235e0c3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:41.260024 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f3b7114b-73fd-4ae3-9673-3f20d235e0c3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:41.334645 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fff36024-48c4-41b5-b69a-f175df7964e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28786 microversion: 2.20 time: 0.894419 Jul 22 22:15:41.335358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 125/250] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:40 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28786 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:41.454704 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3e1053fb-b988-4653-893c-370bb3d27ec9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:41.456214 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3e1053fb-b988-4653-893c-370bb3d27ec9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:41.463840 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e1053fb-b988-4653-893c-370bb3d27ec9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:41.464575 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e1053fb-b988-4653-893c-370bb3d27ec9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:41.466067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e1053fb-b988-4653-893c-370bb3d27ec9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:41.466847 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e1053fb-b988-4653-893c-370bb3d27ec9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:41.559858 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f3b7114b-73fd-4ae3-9673-3f20d235e0c3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:41.573270 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f3b7114b-73fd-4ae3-9673-3f20d235e0c3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1363 microversion: 2.1 time: 0.324933 Jul 22 22:15:41.573864 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 126/251] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:41 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:41.579025 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-69c7f23f-6aff-4ff2-af9e-f3075e63b712 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:41.580439 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-69c7f23f-6aff-4ff2-af9e-f3075e63b712 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:41.587025 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-69c7f23f-6aff-4ff2-af9e-f3075e63b712 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:41.588102 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-69c7f23f-6aff-4ff2-af9e-f3075e63b712 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:41.589472 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-69c7f23f-6aff-4ff2-af9e-f3075e63b712 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:41.591135 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-69c7f23f-6aff-4ff2-af9e-f3075e63b712 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:41.789935 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-69c7f23f-6aff-4ff2-af9e-f3075e63b712 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29277 microversion: 2.1 time: 0.214323 Jul 22 22:15:41.792126 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 127/252] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:41 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:41.887822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3e1053fb-b988-4653-893c-370bb3d27ec9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:41.894888 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3e935503-b57f-4ca6-98cc-2c985df44923 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:41.895608 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3e935503-b57f-4ca6-98cc-2c985df44923 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:41.899032 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3e1053fb-b988-4653-893c-370bb3d27ec9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.448999 Jul 22 22:15:41.900033 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 126/253] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:41 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:41.904137 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3e935503-b57f-4ca6-98cc-2c985df44923 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:41.904707 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3e935503-b57f-4ca6-98cc-2c985df44923 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:41.905798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3e935503-b57f-4ca6-98cc-2c985df44923 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:41.906981 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3e935503-b57f-4ca6-98cc-2c985df44923 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:42.188736 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-14702e06-035a-4d81-93d6-d321ce014d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:42.189347 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-14702e06-035a-4d81-93d6-d321ce014d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:42.199464 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-14702e06-035a-4d81-93d6-d321ce014d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:42.199920 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-14702e06-035a-4d81-93d6-d321ce014d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:42.201305 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-14702e06-035a-4d81-93d6-d321ce014d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:42.201954 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-14702e06-035a-4d81-93d6-d321ce014d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:42.211973 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3e935503-b57f-4ca6-98cc-2c985df44923 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:42.225090 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3e935503-b57f-4ca6-98cc-2c985df44923 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.340357 Jul 22 22:15:42.236165 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 128/254] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:41 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:42.347956 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e6f40694-1976-47b6-8f5c-8b550c1765b7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:42.349663 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e6f40694-1976-47b6-8f5c-8b550c1765b7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:42.357017 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e6f40694-1976-47b6-8f5c-8b550c1765b7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:42.358739 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e6f40694-1976-47b6-8f5c-8b550c1765b7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:42.360783 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e6f40694-1976-47b6-8f5c-8b550c1765b7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:42.361563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e6f40694-1976-47b6-8f5c-8b550c1765b7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:42.468732 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-14702e06-035a-4d81-93d6-d321ce014d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:42.481067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-14702e06-035a-4d81-93d6-d321ce014d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.292669 Jul 22 22:15:42.481067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 127/255] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:42 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:42.490728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-ca2f540e-98ae-4e27-abed-290558fdb4e2 req-8c12d6a2-8559-4347-ae99-62bdb71ccd86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262a2182-82a6-40df-9c4e-e3b094d8770e", "tag": "5e80f502-adcb-4d34-a290-8be7965b509b"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:42.492515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:15:42.492515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:15:42.499305 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-ca2f540e-98ae-4e27-abed-290558fdb4e2 req-8c12d6a2-8559-4347-ae99-62bdb71ccd86 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:42.499734 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-ca2f540e-98ae-4e27-abed-290558fdb4e2 req-8c12d6a2-8559-4347-ae99-62bdb71ccd86 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:42.511456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-ca2f540e-98ae-4e27-abed-290558fdb4e2 req-8c12d6a2-8559-4347-ae99-62bdb71ccd86 service nova] Creating event network-changed:5e80f502-adcb-4d34-a290-8be7965b509b for instance 262a2182-82a6-40df-9c4e-e3b094d8770e on hv-cinder-80186 Jul 22 22:15:42.517029 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-ca2f540e-98ae-4e27-abed-290558fdb4e2 req-8c12d6a2-8559-4347-ae99-62bdb71ccd86 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037477 Jul 22 22:15:42.517954 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 128/256] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:15:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:15:42.602958 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-930d1e0b-6825-4447-b2fa-330690122357 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:42.604483 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-930d1e0b-6825-4447-b2fa-330690122357 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:42.613673 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e6f40694-1976-47b6-8f5c-8b550c1765b7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28786 microversion: 2.20 time: 0.270162 Jul 22 22:15:42.616440 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 129/257] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:42 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28786 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:15:42.620181 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-930d1e0b-6825-4447-b2fa-330690122357 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:42.620888 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-930d1e0b-6825-4447-b2fa-330690122357 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:42.621997 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-930d1e0b-6825-4447-b2fa-330690122357 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:42.622641 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-930d1e0b-6825-4447-b2fa-330690122357 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:42.790090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-930d1e0b-6825-4447-b2fa-330690122357 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:42.798688 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-930d1e0b-6825-4447-b2fa-330690122357 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1363 microversion: 2.1 time: 0.200369 Jul 22 22:15:42.799595 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 129/258] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:42 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:42.806114 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-512a9b0c-920a-4f11-99dd-53c6942d4a89 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:42.807207 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-512a9b0c-920a-4f11-99dd-53c6942d4a89 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:42.814168 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-512a9b0c-920a-4f11-99dd-53c6942d4a89 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:42.814603 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-512a9b0c-920a-4f11-99dd-53c6942d4a89 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:42.815546 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-512a9b0c-920a-4f11-99dd-53c6942d4a89 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:42.815977 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-512a9b0c-920a-4f11-99dd-53c6942d4a89 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:42.922785 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a3415ca1-7729-43da-aac3-e4bef4280e21 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:42.923675 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a3415ca1-7729-43da-aac3-e4bef4280e21 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:42.930368 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3415ca1-7729-43da-aac3-e4bef4280e21 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:42.930802 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3415ca1-7729-43da-aac3-e4bef4280e21 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:42.931586 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3415ca1-7729-43da-aac3-e4bef4280e21 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:42.932086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3415ca1-7729-43da-aac3-e4bef4280e21 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:43.082763 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a3415ca1-7729-43da-aac3-e4bef4280e21 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:43.091133 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a3415ca1-7729-43da-aac3-e4bef4280e21 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.173038 Jul 22 22:15:43.091719 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 130/259] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:42 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:43.131220 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-512a9b0c-920a-4f11-99dd-53c6942d4a89 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29277 microversion: 2.1 time: 0.329192 Jul 22 22:15:43.131781 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 130/260] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:42 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29277 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:43.242798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e771c120-870d-42db-8d2e-1a61a440ddb3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:43.243409 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e771c120-870d-42db-8d2e-1a61a440ddb3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:43.249481 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e771c120-870d-42db-8d2e-1a61a440ddb3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:43.250500 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e771c120-870d-42db-8d2e-1a61a440ddb3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:43.252028 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e771c120-870d-42db-8d2e-1a61a440ddb3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:43.253258 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e771c120-870d-42db-8d2e-1a61a440ddb3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:43.413493 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e771c120-870d-42db-8d2e-1a61a440ddb3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:43.421563 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e771c120-870d-42db-8d2e-1a61a440ddb3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.182366 Jul 22 22:15:43.422495 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 131/261] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:43 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:43.495450 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-492e7bc4-e815-4286-8734-d6251dbced03 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:43.496148 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-492e7bc4-e815-4286-8734-d6251dbced03 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:43.505831 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-492e7bc4-e815-4286-8734-d6251dbced03 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:43.506746 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-492e7bc4-e815-4286-8734-d6251dbced03 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:43.508067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-492e7bc4-e815-4286-8734-d6251dbced03 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:43.508533 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-492e7bc4-e815-4286-8734-d6251dbced03 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:43.627882 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ae82a1bb-46b4-4e50-9761-2b79276b7e74 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:43.630498 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ae82a1bb-46b4-4e50-9761-2b79276b7e74 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:43.643713 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae82a1bb-46b4-4e50-9761-2b79276b7e74 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:43.644369 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae82a1bb-46b4-4e50-9761-2b79276b7e74 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:43.645785 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae82a1bb-46b4-4e50-9761-2b79276b7e74 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:43.646464 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae82a1bb-46b4-4e50-9761-2b79276b7e74 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:43.793116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-492e7bc4-e815-4286-8734-d6251dbced03 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:43.802763 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-492e7bc4-e815-4286-8734-d6251dbced03 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.311287 Jul 22 22:15:43.803584 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 131/262] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:43 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:43.814934 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2d2fd0c8-dba1-4d73-b062-2d797519ddb4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:43.816080 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2d2fd0c8-dba1-4d73-b062-2d797519ddb4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:43.823552 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2d2fd0c8-dba1-4d73-b062-2d797519ddb4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:43.824020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2d2fd0c8-dba1-4d73-b062-2d797519ddb4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:43.824941 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2d2fd0c8-dba1-4d73-b062-2d797519ddb4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:43.825362 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2d2fd0c8-dba1-4d73-b062-2d797519ddb4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:43.846173 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ae82a1bb-46b4-4e50-9761-2b79276b7e74 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28786 microversion: 2.20 time: 0.223416 Jul 22 22:15:43.847095 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 132/263] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:43 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28786 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:44.110180 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5187bf76-1fc1-4b2c-b4ca-69ed53d1821a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:44.110888 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5187bf76-1fc1-4b2c-b4ca-69ed53d1821a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:44.117633 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5187bf76-1fc1-4b2c-b4ca-69ed53d1821a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.118088 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5187bf76-1fc1-4b2c-b4ca-69ed53d1821a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.118911 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5187bf76-1fc1-4b2c-b4ca-69ed53d1821a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.119349 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5187bf76-1fc1-4b2c-b4ca-69ed53d1821a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.162237 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2d2fd0c8-dba1-4d73-b062-2d797519ddb4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:44.172330 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2d2fd0c8-dba1-4d73-b062-2d797519ddb4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1551 microversion: 2.1 time: 0.360911 Jul 22 22:15:44.173731 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 132/264] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:43 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1551 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:44.197127 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c4ed85d2-6d2f-48c5-86a5-78055dc9f3dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:44.198676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c4ed85d2-6d2f-48c5-86a5-78055dc9f3dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:44.210137 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c4ed85d2-6d2f-48c5-86a5-78055dc9f3dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.210799 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c4ed85d2-6d2f-48c5-86a5-78055dc9f3dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.212194 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c4ed85d2-6d2f-48c5-86a5-78055dc9f3dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.212994 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c4ed85d2-6d2f-48c5-86a5-78055dc9f3dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.300796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5187bf76-1fc1-4b2c-b4ca-69ed53d1821a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:44.308844 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5187bf76-1fc1-4b2c-b4ca-69ed53d1821a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.203280 Jul 22 22:15:44.318102 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 133/265] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:44 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:44.318102 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b1aecea0-8f39-44ef-8d67-fefe9795686a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:44.318102 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b1aecea0-8f39-44ef-8d67-fefe9795686a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:44.322284 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b1aecea0-8f39-44ef-8d67-fefe9795686a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.322737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b1aecea0-8f39-44ef-8d67-fefe9795686a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.323550 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b1aecea0-8f39-44ef-8d67-fefe9795686a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.323991 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b1aecea0-8f39-44ef-8d67-fefe9795686a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.398235 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c4ed85d2-6d2f-48c5-86a5-78055dc9f3dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29277 microversion: 2.1 time: 0.217124 Jul 22 22:15:44.398909 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 133/266] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:44 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:44.443096 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c10ff6b1-ad3b-4794-92e3-fa50c1269377 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:44.443793 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c10ff6b1-ad3b-4794-92e3-fa50c1269377 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:44.452912 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c10ff6b1-ad3b-4794-92e3-fa50c1269377 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.454174 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c10ff6b1-ad3b-4794-92e3-fa50c1269377 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.455142 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c10ff6b1-ad3b-4794-92e3-fa50c1269377 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.455586 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c10ff6b1-ad3b-4794-92e3-fa50c1269377 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.499382 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b1aecea0-8f39-44ef-8d67-fefe9795686a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:44.513854 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b1aecea0-8f39-44ef-8d67-fefe9795686a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1551 microversion: 2.1 time: 0.203143 Jul 22 22:15:44.514637 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 134/267] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:44 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1551 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:44.530313 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fdb6d682-8ed9-4da8-95e6-bfb744fd0372 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:44.534329 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:15:44.534329 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:15:44.535356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fdb6d682-8ed9-4da8-95e6-bfb744fd0372 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:44.536107 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fdb6d682-8ed9-4da8-95e6-bfb744fd0372 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Searching by: {'deleted': False, 'project_id': '75448bc245984a73a936769d77050816'} {{(pid=107498) get_all /opt/stack/nova/nova/compute/api.py:2835}} Jul 22 22:15:44.542922 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fdb6d682-8ed9-4da8-95e6-bfb744fd0372 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.543374 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fdb6d682-8ed9-4da8-95e6-bfb744fd0372 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.544312 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fdb6d682-8ed9-4da8-95e6-bfb744fd0372 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.544662 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fdb6d682-8ed9-4da8-95e6-bfb744fd0372 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.632100 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c10ff6b1-ad3b-4794-92e3-fa50c1269377 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:44.639892 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c10ff6b1-ad3b-4794-92e3-fa50c1269377 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.201940 Jul 22 22:15:44.641501 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 134/268] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:44 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:44.688933 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.multi_cell_list [None req-fdb6d682-8ed9-4da8-95e6-bfb744fd0372 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=107498) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jul 22 22:15:44.813327 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fdb6d682-8ed9-4da8-95e6-bfb744fd0372 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers" status: 200 len: 345 microversion: 2.1 time: 0.285856 Jul 22 22:15:44.814367 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 135/269] 10.222.0.110 () {58 vars in 1130 bytes} [Thu Jul 22 22:15:44 2021] GET /compute/v2.1/servers => generated 345 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:15:44.826833 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e7c9e347-f0a1-43f0-9d22-765aafd48ae1 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:44.827500 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e7c9e347-f0a1-43f0-9d22-765aafd48ae1 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:44.834663 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9eba8321-2a33-40d7-98b4-5972e1524155 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:44.836415 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9eba8321-2a33-40d7-98b4-5972e1524155 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:44.836585 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7c9e347-f0a1-43f0-9d22-765aafd48ae1 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.836995 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7c9e347-f0a1-43f0-9d22-765aafd48ae1 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.837982 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7c9e347-f0a1-43f0-9d22-765aafd48ae1 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.838589 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7c9e347-f0a1-43f0-9d22-765aafd48ae1 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.845640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9eba8321-2a33-40d7-98b4-5972e1524155 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.846433 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9eba8321-2a33-40d7-98b4-5972e1524155 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:44.847795 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9eba8321-2a33-40d7-98b4-5972e1524155 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:44.848580 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9eba8321-2a33-40d7-98b4-5972e1524155 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:45.020990 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e7c9e347-f0a1-43f0-9d22-765aafd48ae1 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:45.042870 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e7c9e347-f0a1-43f0-9d22-765aafd48ae1 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1551 microversion: 2.1 time: 0.219495 Jul 22 22:15:45.043564 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 135/270] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:44 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1551 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:45.049928 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-751b5124-a994-465b-b987-718ee06912c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:45.051207 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-751b5124-a994-465b-b987-718ee06912c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:45.059192 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9eba8321-2a33-40d7-98b4-5972e1524155 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:45.063223 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-751b5124-a994-465b-b987-718ee06912c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:45.064856 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-751b5124-a994-465b-b987-718ee06912c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:45.066584 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-751b5124-a994-465b-b987-718ee06912c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:45.067261 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-751b5124-a994-465b-b987-718ee06912c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:45.076626 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9eba8321-2a33-40d7-98b4-5972e1524155 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.252273 Jul 22 22:15:45.077582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 136/271] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:44 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:45.329128 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-64336062-6dad-464a-a8b3-a4e8a540e67c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:45.329764 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-64336062-6dad-464a-a8b3-a4e8a540e67c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:45.337785 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-64336062-6dad-464a-a8b3-a4e8a540e67c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:45.338473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-64336062-6dad-464a-a8b3-a4e8a540e67c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:45.339526 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-64336062-6dad-464a-a8b3-a4e8a540e67c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:45.339860 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-64336062-6dad-464a-a8b3-a4e8a540e67c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:45.391469 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-751b5124-a994-465b-b987-718ee06912c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28786 microversion: 2.20 time: 0.345633 Jul 22 22:15:45.392199 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 136/272] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:45 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28786 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:45.417402 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8fbf108f-b736-437a-ab9b-104abb213057 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:45.419248 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8fbf108f-b736-437a-ab9b-104abb213057 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:45.440158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8fbf108f-b736-437a-ab9b-104abb213057 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:45.441600 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8fbf108f-b736-437a-ab9b-104abb213057 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:45.443758 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8fbf108f-b736-437a-ab9b-104abb213057 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:45.444672 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8fbf108f-b736-437a-ab9b-104abb213057 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:45.569196 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-64336062-6dad-464a-a8b3-a4e8a540e67c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:45.580646 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-64336062-6dad-464a-a8b3-a4e8a540e67c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.256765 Jul 22 22:15:45.581898 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 137/273] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:45 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:45.650692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8fbf108f-b736-437a-ab9b-104abb213057 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29277 microversion: 2.1 time: 0.241703 Jul 22 22:15:45.654854 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 137/274] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:45 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:15:45.660205 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9fb6509d-a0a3-4819-a8c0-c817775a9804 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:45.660841 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9fb6509d-a0a3-4819-a8c0-c817775a9804 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:45.669025 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9fb6509d-a0a3-4819-a8c0-c817775a9804 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:45.669769 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9fb6509d-a0a3-4819-a8c0-c817775a9804 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:45.670944 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9fb6509d-a0a3-4819-a8c0-c817775a9804 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:45.671393 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9fb6509d-a0a3-4819-a8c0-c817775a9804 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:45.869112 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9fb6509d-a0a3-4819-a8c0-c817775a9804 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:45.879016 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9fb6509d-a0a3-4819-a8c0-c817775a9804 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.223391 Jul 22 22:15:45.888391 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 138/275] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:45 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:45.915979 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-050f20be-ebfb-4ced-bdf9-1193e346291a req-3f7ceea9-df20-4f68-b2ee-85a19b5e8284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae", "name": "network-vif-plugged", "status": "completed", "tag": "4cae57e3-646c-477f-9363-d0fd4b8135a7"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:45.917623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:15:45.917623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:15:45.925960 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-050f20be-ebfb-4ced-bdf9-1193e346291a req-3f7ceea9-df20-4f68-b2ee-85a19b5e8284 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:45.926573 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-050f20be-ebfb-4ced-bdf9-1193e346291a req-3f7ceea9-df20-4f68-b2ee-85a19b5e8284 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:45.938791 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-050f20be-ebfb-4ced-bdf9-1193e346291a req-3f7ceea9-df20-4f68-b2ee-85a19b5e8284 service nova] Creating event network-vif-plugged:4cae57e3-646c-477f-9363-d0fd4b8135a7 for instance c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae on hv-cinder-80186 Jul 22 22:15:45.943592 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-050f20be-ebfb-4ced-bdf9-1193e346291a req-3f7ceea9-df20-4f68-b2ee-85a19b5e8284 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031593 Jul 22 22:15:45.944193 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 138/276] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:15:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:15:46.096401 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0746aa40-4b9d-421c-9c16-724b3f730bef tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:46.097042 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0746aa40-4b9d-421c-9c16-724b3f730bef tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:46.103867 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0746aa40-4b9d-421c-9c16-724b3f730bef tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:46.104432 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0746aa40-4b9d-421c-9c16-724b3f730bef tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:46.105260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0746aa40-4b9d-421c-9c16-724b3f730bef tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:46.105662 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0746aa40-4b9d-421c-9c16-724b3f730bef tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:46.271304 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0746aa40-4b9d-421c-9c16-724b3f730bef tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:46.279004 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0746aa40-4b9d-421c-9c16-724b3f730bef tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.187505 Jul 22 22:15:46.279580 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 139/277] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:46 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:46.403984 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-032cd648-394b-4324-9f7a-516c939587de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:46.405347 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-032cd648-394b-4324-9f7a-516c939587de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:46.414251 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-032cd648-394b-4324-9f7a-516c939587de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:46.414704 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-032cd648-394b-4324-9f7a-516c939587de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:46.415569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-032cd648-394b-4324-9f7a-516c939587de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:46.416000 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-032cd648-394b-4324-9f7a-516c939587de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:46.604855 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2b64512c-dfcb-48ea-8355-d8a84aa632e5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:46.605830 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2b64512c-dfcb-48ea-8355-d8a84aa632e5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:46.623455 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b64512c-dfcb-48ea-8355-d8a84aa632e5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:46.623455 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b64512c-dfcb-48ea-8355-d8a84aa632e5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:46.623455 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b64512c-dfcb-48ea-8355-d8a84aa632e5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:46.623455 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b64512c-dfcb-48ea-8355-d8a84aa632e5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:46.923052 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2b64512c-dfcb-48ea-8355-d8a84aa632e5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:46.933790 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2b64512c-dfcb-48ea-8355-d8a84aa632e5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.336757 Jul 22 22:15:46.934490 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 140/278] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:46 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:46.946071 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4ea0645a-9df0-431f-945a-a064236a602a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:46.947156 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4ea0645a-9df0-431f-945a-a064236a602a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:46.954990 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ea0645a-9df0-431f-945a-a064236a602a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:46.955433 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ea0645a-9df0-431f-945a-a064236a602a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:46.956346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ea0645a-9df0-431f-945a-a064236a602a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:46.956813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ea0645a-9df0-431f-945a-a064236a602a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:47.074592 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-032cd648-394b-4324-9f7a-516c939587de tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28786 microversion: 2.20 time: 0.673610 Jul 22 22:15:47.076093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 139/279] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:46 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28786 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:15:47.082487 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fb8b8319-247b-4d73-97d1-0e93456dccbe tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:47.083234 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fb8b8319-247b-4d73-97d1-0e93456dccbe tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:47.090811 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fb8b8319-247b-4d73-97d1-0e93456dccbe tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:47.091502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fb8b8319-247b-4d73-97d1-0e93456dccbe tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:47.092927 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fb8b8319-247b-4d73-97d1-0e93456dccbe tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:47.095118 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fb8b8319-247b-4d73-97d1-0e93456dccbe tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:47.279154 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fb8b8319-247b-4d73-97d1-0e93456dccbe tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:47.287525 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fb8b8319-247b-4d73-97d1-0e93456dccbe tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.209794 Jul 22 22:15:47.288268 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 140/280] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:47 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:47.297205 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-22cc0ed6-be73-48b5-bb98-d25ecd57be0e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7031506c-04e5-4699-b7ca-4f07339d2573"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:47.299085 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-22cc0ed6-be73-48b5-bb98-d25ecd57be0e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:47.308231 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22cc0ed6-be73-48b5-bb98-d25ecd57be0e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:47.308974 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22cc0ed6-be73-48b5-bb98-d25ecd57be0e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:47.310351 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22cc0ed6-be73-48b5-bb98-d25ecd57be0e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:47.310983 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22cc0ed6-be73-48b5-bb98-d25ecd57be0e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:47.326176 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4ea0645a-9df0-431f-945a-a064236a602a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29277 microversion: 2.1 time: 0.389803 Jul 22 22:15:47.326725 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 141/281] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:46 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29277 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:47.332413 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fa283511-3228-4b30-b51d-13d4b44e7ec3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:47.333187 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fa283511-3228-4b30-b51d-13d4b44e7ec3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:47.339834 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fa283511-3228-4b30-b51d-13d4b44e7ec3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:47.340303 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fa283511-3228-4b30-b51d-13d4b44e7ec3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:47.341116 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fa283511-3228-4b30-b51d-13d4b44e7ec3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:47.341545 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fa283511-3228-4b30-b51d-13d4b44e7ec3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:47.529697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fa283511-3228-4b30-b51d-13d4b44e7ec3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:47.539505 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fa283511-3228-4b30-b51d-13d4b44e7ec3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.211545 Jul 22 22:15:47.540168 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 142/282] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:47 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:47.709031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-22cc0ed6-be73-48b5-bb98-d25ecd57be0e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "POST /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418176 Jul 22 22:15:47.709730 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 141/283] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:15:47 2021] POST /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:15:47.951034 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e4e34407-dd94-4faa-8d3c-666872832338 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:47.951848 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e4e34407-dd94-4faa-8d3c-666872832338 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:47.959614 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e4e34407-dd94-4faa-8d3c-666872832338 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:47.960058 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e4e34407-dd94-4faa-8d3c-666872832338 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:47.960889 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e4e34407-dd94-4faa-8d3c-666872832338 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:47.961328 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e4e34407-dd94-4faa-8d3c-666872832338 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:47.962903 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-0dfcef2f-24cf-48b9-8233-514dbab1d0b7 req-1a950a10-7fa9-4bb6-8bcc-f4988cff2088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc8f297-285c-45e7-912f-a3f64a0d4e9b", "name": "network-vif-plugged", "status": "completed", "tag": "254ffb11-410d-4f28-ab52-4f5ed744c1df"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:47.964538 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:15:47.964538 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:15:47.973472 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-0dfcef2f-24cf-48b9-8233-514dbab1d0b7 req-1a950a10-7fa9-4bb6-8bcc-f4988cff2088 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:47.973993 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-0dfcef2f-24cf-48b9-8233-514dbab1d0b7 req-1a950a10-7fa9-4bb6-8bcc-f4988cff2088 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:47.986691 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-0dfcef2f-24cf-48b9-8233-514dbab1d0b7 req-1a950a10-7fa9-4bb6-8bcc-f4988cff2088 service nova] Creating event network-vif-plugged:254ffb11-410d-4f28-ab52-4f5ed744c1df for instance 4fc8f297-285c-45e7-912f-a3f64a0d4e9b on hv-cinder-80186 Jul 22 22:15:47.994090 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-0dfcef2f-24cf-48b9-8233-514dbab1d0b7 req-1a950a10-7fa9-4bb6-8bcc-f4988cff2088 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033198 Jul 22 22:15:47.994090 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 142/284] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:15:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:15:48.110654 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4d676ade-18fd-45fa-938d-849faca0d875 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:48.110654 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4d676ade-18fd-45fa-938d-849faca0d875 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:48.122199 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d676ade-18fd-45fa-938d-849faca0d875 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:48.122657 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d676ade-18fd-45fa-938d-849faca0d875 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:48.123435 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d676ade-18fd-45fa-938d-849faca0d875 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:48.132751 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d676ade-18fd-45fa-938d-849faca0d875 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:48.155402 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e4e34407-dd94-4faa-8d3c-666872832338 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:48.163474 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e4e34407-dd94-4faa-8d3c-666872832338 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.216110 Jul 22 22:15:48.164409 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 143/285] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:47 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:48.306390 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-832d2369-a48d-4f75-9700-f8bb77f41298 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:48.307121 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-832d2369-a48d-4f75-9700-f8bb77f41298 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:48.314114 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-832d2369-a48d-4f75-9700-f8bb77f41298 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:48.314642 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-832d2369-a48d-4f75-9700-f8bb77f41298 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:48.315429 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-832d2369-a48d-4f75-9700-f8bb77f41298 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:48.315857 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-832d2369-a48d-4f75-9700-f8bb77f41298 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:48.412589 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4d676ade-18fd-45fa-938d-849faca0d875 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 28786 microversion: 2.20 time: 0.325170 Jul 22 22:15:48.414098 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 143/286] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:48 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 28786 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:15:48.422364 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0d4bbb66-0a68-4216-bea3-341afa373b2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:48.424234 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0d4bbb66-0a68-4216-bea3-341afa373b2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:48.433387 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d4bbb66-0a68-4216-bea3-341afa373b2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:48.434397 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d4bbb66-0a68-4216-bea3-341afa373b2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:48.435839 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d4bbb66-0a68-4216-bea3-341afa373b2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:48.436515 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d4bbb66-0a68-4216-bea3-341afa373b2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:48.518021 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-832d2369-a48d-4f75-9700-f8bb77f41298 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:48.527776 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-832d2369-a48d-4f75-9700-f8bb77f41298 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.226406 Jul 22 22:15:48.528570 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 144/287] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:48 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:48.556646 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4739b807-aac1-4d6c-bcf1-82736b8436be tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:48.557435 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4739b807-aac1-4d6c-bcf1-82736b8436be tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:48.565526 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4739b807-aac1-4d6c-bcf1-82736b8436be tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:48.565998 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4739b807-aac1-4d6c-bcf1-82736b8436be tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:48.566800 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4739b807-aac1-4d6c-bcf1-82736b8436be tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:48.567239 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4739b807-aac1-4d6c-bcf1-82736b8436be tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:48.743955 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4739b807-aac1-4d6c-bcf1-82736b8436be tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:48.761498 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4739b807-aac1-4d6c-bcf1-82736b8436be tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.208017 Jul 22 22:15:48.770608 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 145/288] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:48 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:49.194209 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1cc3c690-0752-4bc7-ac84-ed3e9f4b808d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:49.195239 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1cc3c690-0752-4bc7-ac84-ed3e9f4b808d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:49.202515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1cc3c690-0752-4bc7-ac84-ed3e9f4b808d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:49.204141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1cc3c690-0752-4bc7-ac84-ed3e9f4b808d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:49.205288 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1cc3c690-0752-4bc7-ac84-ed3e9f4b808d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:49.205820 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1cc3c690-0752-4bc7-ac84-ed3e9f4b808d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:49.357296 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0d4bbb66-0a68-4216-bea3-341afa373b2a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29441 microversion: 2.1 time: 0.938336 Jul 22 22:15:49.358696 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 144/289] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:48 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29441 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:49.389972 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1cc3c690-0752-4bc7-ac84-ed3e9f4b808d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:49.402189 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1cc3c690-0752-4bc7-ac84-ed3e9f4b808d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.215510 Jul 22 22:15:49.402776 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 146/290] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:49 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:49.426169 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c1b5d028-24cb-4f09-8d34-4fae60ed33e8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:49.427312 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c1b5d028-24cb-4f09-8d34-4fae60ed33e8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:49.435419 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c1b5d028-24cb-4f09-8d34-4fae60ed33e8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:49.435942 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c1b5d028-24cb-4f09-8d34-4fae60ed33e8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:49.437013 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c1b5d028-24cb-4f09-8d34-4fae60ed33e8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:49.438934 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c1b5d028-24cb-4f09-8d34-4fae60ed33e8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:49.552909 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d7bceddd-c098-4a72-afd7-0c5f7363978b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:49.555827 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d7bceddd-c098-4a72-afd7-0c5f7363978b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:49.569100 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7bceddd-c098-4a72-afd7-0c5f7363978b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:49.570006 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7bceddd-c098-4a72-afd7-0c5f7363978b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:49.571357 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7bceddd-c098-4a72-afd7-0c5f7363978b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:49.572191 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7bceddd-c098-4a72-afd7-0c5f7363978b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:49.774261 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c1b5d028-24cb-4f09-8d34-4fae60ed33e8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 29304 microversion: 2.20 time: 0.352424 Jul 22 22:15:49.776963 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 145/291] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:49 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 29304 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:49.787775 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8b448985-0521-4c05-b876-50a1351e91b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:49.809780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8b448985-0521-4c05-b876-50a1351e91b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:49.819512 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b448985-0521-4c05-b876-50a1351e91b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:49.820482 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b448985-0521-4c05-b876-50a1351e91b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:49.821796 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b448985-0521-4c05-b876-50a1351e91b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:49.822452 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b448985-0521-4c05-b876-50a1351e91b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:50.059929 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d7bceddd-c098-4a72-afd7-0c5f7363978b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:50.067759 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8b448985-0521-4c05-b876-50a1351e91b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:50.068611 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d7bceddd-c098-4a72-afd7-0c5f7363978b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.525476 Jul 22 22:15:50.070142 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 147/292] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:49 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:50.076662 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-936de0c4-0ded-476f-9473-e81be62a5800 req-1ae0224d-e800-4ce8-afd6-f7dd27983a0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b32a316-01f1-4ac2-9c15-708742d4afac", "name": "network-vif-plugged", "status": "completed", "tag": "78cc8d65-ba06-4a10-a7de-a5a8599859dd"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:50.078956 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:15:50.078956 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:15:50.087506 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-936de0c4-0ded-476f-9473-e81be62a5800 req-1ae0224d-e800-4ce8-afd6-f7dd27983a0b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:50.088255 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-936de0c4-0ded-476f-9473-e81be62a5800 req-1ae0224d-e800-4ce8-afd6-f7dd27983a0b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:50.091589 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8b448985-0521-4c05-b876-50a1351e91b7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.312009 Jul 22 22:15:50.092314 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 146/293] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:49 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:50.111938 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-936de0c4-0ded-476f-9473-e81be62a5800 req-1ae0224d-e800-4ce8-afd6-f7dd27983a0b service nova] Creating event network-vif-plugged:78cc8d65-ba06-4a10-a7de-a5a8599859dd for instance 2b32a316-01f1-4ac2-9c15-708742d4afac on hv-cinder-80186 Jul 22 22:15:50.121573 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-936de0c4-0ded-476f-9473-e81be62a5800 req-1ae0224d-e800-4ce8-afd6-f7dd27983a0b service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046962 Jul 22 22:15:50.122531 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 148/294] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:15:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:15:50.373258 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a2624b99-5d7f-4ada-b292-86abfcd19fc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:50.374195 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a2624b99-5d7f-4ada-b292-86abfcd19fc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:50.381852 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a2624b99-5d7f-4ada-b292-86abfcd19fc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:50.382289 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a2624b99-5d7f-4ada-b292-86abfcd19fc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:50.383125 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a2624b99-5d7f-4ada-b292-86abfcd19fc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:50.383556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a2624b99-5d7f-4ada-b292-86abfcd19fc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:50.425529 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b5c56e04-3fdf-4ff8-8b22-8cc98980ac41 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:50.432014 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b5c56e04-3fdf-4ff8-8b22-8cc98980ac41 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:50.445901 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b5c56e04-3fdf-4ff8-8b22-8cc98980ac41 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:50.446653 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b5c56e04-3fdf-4ff8-8b22-8cc98980ac41 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:50.448116 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b5c56e04-3fdf-4ff8-8b22-8cc98980ac41 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:50.449154 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b5c56e04-3fdf-4ff8-8b22-8cc98980ac41 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:50.646401 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a2624b99-5d7f-4ada-b292-86abfcd19fc6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 29934 microversion: 2.1 time: 0.278693 Jul 22 22:15:50.651763 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 147/295] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:50 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 29934 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:15:50.792008 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-76b8ac7d-fc4c-4552-a5fe-070396afff2d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:50.793569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-76b8ac7d-fc4c-4552-a5fe-070396afff2d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:50.804327 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76b8ac7d-fc4c-4552-a5fe-070396afff2d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:50.805179 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76b8ac7d-fc4c-4552-a5fe-070396afff2d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:50.806021 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76b8ac7d-fc4c-4552-a5fe-070396afff2d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:50.806453 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76b8ac7d-fc4c-4552-a5fe-070396afff2d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:50.877171 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b5c56e04-3fdf-4ff8-8b22-8cc98980ac41 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:50.885274 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b5c56e04-3fdf-4ff8-8b22-8cc98980ac41 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.466880 Jul 22 22:15:50.885876 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 149/296] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:50 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:51.094751 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6caa187e-5110-407c-87da-36a33da7d81e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:51.095828 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6caa187e-5110-407c-87da-36a33da7d81e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:51.102066 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6caa187e-5110-407c-87da-36a33da7d81e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:51.102520 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6caa187e-5110-407c-87da-36a33da7d81e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:51.103355 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6caa187e-5110-407c-87da-36a33da7d81e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:51.104104 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6caa187e-5110-407c-87da-36a33da7d81e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:51.335482 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6caa187e-5110-407c-87da-36a33da7d81e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:51.353733 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6caa187e-5110-407c-87da-36a33da7d81e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.263249 Jul 22 22:15:51.354346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 150/297] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:51 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:51.359333 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3447bc6d-d879-492a-bf87-2660290bf932 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:51.360293 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3447bc6d-d879-492a-bf87-2660290bf932 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:51.367047 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3447bc6d-d879-492a-bf87-2660290bf932 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:51.367596 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3447bc6d-d879-492a-bf87-2660290bf932 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:51.368645 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3447bc6d-d879-492a-bf87-2660290bf932 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:51.369272 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3447bc6d-d879-492a-bf87-2660290bf932 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:51.551069 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3447bc6d-d879-492a-bf87-2660290bf932 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:51.564124 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3447bc6d-d879-492a-bf87-2660290bf932 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1322 microversion: 2.1 time: 0.208450 Jul 22 22:15:51.565093 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 151/298] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:51 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:51.662557 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1fa0b834-96e6-4952-b74c-8d953a639c17 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:51.664300 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1fa0b834-96e6-4952-b74c-8d953a639c17 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:51.675845 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1fa0b834-96e6-4952-b74c-8d953a639c17 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:51.676580 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1fa0b834-96e6-4952-b74c-8d953a639c17 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:51.677675 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1fa0b834-96e6-4952-b74c-8d953a639c17 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:51.678258 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1fa0b834-96e6-4952-b74c-8d953a639c17 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:51.805334 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-76b8ac7d-fc4c-4552-a5fe-070396afff2d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 30024 microversion: 2.20 time: 1.019499 Jul 22 22:15:51.807809 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 148/299] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:50 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 30024 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:15:51.904026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-898da554-c0ec-4f95-b2be-32fc43bd0e3a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:51.904783 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-898da554-c0ec-4f95-b2be-32fc43bd0e3a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:51.914031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-898da554-c0ec-4f95-b2be-32fc43bd0e3a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:51.914031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-898da554-c0ec-4f95-b2be-32fc43bd0e3a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:51.914628 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-898da554-c0ec-4f95-b2be-32fc43bd0e3a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:51.915151 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-898da554-c0ec-4f95-b2be-32fc43bd0e3a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:52.082772 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-898da554-c0ec-4f95-b2be-32fc43bd0e3a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:52.092875 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-898da554-c0ec-4f95-b2be-32fc43bd0e3a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.193197 Jul 22 22:15:52.094189 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 149/300] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:51 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:52.220760 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1fa0b834-96e6-4952-b74c-8d953a639c17 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 30547 microversion: 2.1 time: 0.564704 Jul 22 22:15:52.221730 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 152/301] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:51 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 30547 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:52.372030 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-03786221-a595-4f16-855a-71709561ddf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:52.372770 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-03786221-a595-4f16-855a-71709561ddf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:52.383659 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03786221-a595-4f16-855a-71709561ddf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:52.384633 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03786221-a595-4f16-855a-71709561ddf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:52.385758 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03786221-a595-4f16-855a-71709561ddf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:52.386454 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03786221-a595-4f16-855a-71709561ddf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:52.577547 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-03786221-a595-4f16-855a-71709561ddf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:52.587333 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-03786221-a595-4f16-855a-71709561ddf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.219046 Jul 22 22:15:52.588256 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 150/302] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:52 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:52.589501 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-24b9e069-56d8-49e3-8fa6-5a31c764cd3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:52.590218 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-24b9e069-56d8-49e3-8fa6-5a31c764cd3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:52.598074 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24b9e069-56d8-49e3-8fa6-5a31c764cd3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:52.598526 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24b9e069-56d8-49e3-8fa6-5a31c764cd3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:52.599358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24b9e069-56d8-49e3-8fa6-5a31c764cd3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:52.599798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24b9e069-56d8-49e3-8fa6-5a31c764cd3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:52.819827 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2f6741f7-cb76-4c09-a902-4e36b25d5f33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:52.821187 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2f6741f7-cb76-4c09-a902-4e36b25d5f33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:52.827593 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2f6741f7-cb76-4c09-a902-4e36b25d5f33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:52.829024 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2f6741f7-cb76-4c09-a902-4e36b25d5f33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:52.829927 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2f6741f7-cb76-4c09-a902-4e36b25d5f33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:52.830418 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2f6741f7-cb76-4c09-a902-4e36b25d5f33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:52.930803 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-24b9e069-56d8-49e3-8fa6-5a31c764cd3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:52.940844 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-24b9e069-56d8-49e3-8fa6-5a31c764cd3e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1512 microversion: 2.1 time: 0.355360 Jul 22 22:15:52.941416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 153/303] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:52 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1512 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:53.076763 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2f6741f7-cb76-4c09-a902-4e36b25d5f33 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 30655 microversion: 2.20 time: 0.261068 Jul 22 22:15:53.077759 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 151/304] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:52 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 30655 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:15:53.111796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f2856051-6058-4f61-8316-8f50bafd9a91 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:53.112697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f2856051-6058-4f61-8316-8f50bafd9a91 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:53.120868 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f2856051-6058-4f61-8316-8f50bafd9a91 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:53.121795 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f2856051-6058-4f61-8316-8f50bafd9a91 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:53.123348 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f2856051-6058-4f61-8316-8f50bafd9a91 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:53.124216 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f2856051-6058-4f61-8316-8f50bafd9a91 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:53.235304 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a0406f18-9e29-42f0-8327-65318bedd5a0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:53.236495 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a0406f18-9e29-42f0-8327-65318bedd5a0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:53.248593 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0406f18-9e29-42f0-8327-65318bedd5a0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:53.249352 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0406f18-9e29-42f0-8327-65318bedd5a0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:53.250348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0406f18-9e29-42f0-8327-65318bedd5a0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:53.250998 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0406f18-9e29-42f0-8327-65318bedd5a0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:53.354901 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f2856051-6058-4f61-8316-8f50bafd9a91 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:53.363093 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f2856051-6058-4f61-8316-8f50bafd9a91 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.255798 Jul 22 22:15:53.372304 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 154/305] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:53 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:53.539085 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a0406f18-9e29-42f0-8327-65318bedd5a0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 31085 microversion: 2.1 time: 0.308543 Jul 22 22:15:53.543607 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 152/306] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:53 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 31085 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:53.605757 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-245f37f6-e18a-4cd4-9ebb-ec1677e9359e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:53.606447 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-245f37f6-e18a-4cd4-9ebb-ec1677e9359e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:53.613490 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-245f37f6-e18a-4cd4-9ebb-ec1677e9359e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:53.614105 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-245f37f6-e18a-4cd4-9ebb-ec1677e9359e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:53.615203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-245f37f6-e18a-4cd4-9ebb-ec1677e9359e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:53.615573 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-245f37f6-e18a-4cd4-9ebb-ec1677e9359e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:53.777702 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-245f37f6-e18a-4cd4-9ebb-ec1677e9359e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:53.785882 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-245f37f6-e18a-4cd4-9ebb-ec1677e9359e tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.183994 Jul 22 22:15:53.786464 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 155/307] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:53 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:53.866931 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-574a21b8-b6db-4da8-a616-bde745de1f78 req-296c8567-435f-4ef4-82bc-e36c053bf00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262a2182-82a6-40df-9c4e-e3b094d8770e", "name": "network-vif-plugged", "status": "completed", "tag": "5e80f502-adcb-4d34-a290-8be7965b509b"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:53.870296 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:15:53.870296 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:15:53.880213 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-574a21b8-b6db-4da8-a616-bde745de1f78 req-296c8567-435f-4ef4-82bc-e36c053bf00e service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:53.880747 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-574a21b8-b6db-4da8-a616-bde745de1f78 req-296c8567-435f-4ef4-82bc-e36c053bf00e service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:53.894473 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-574a21b8-b6db-4da8-a616-bde745de1f78 req-296c8567-435f-4ef4-82bc-e36c053bf00e service nova] Creating event network-vif-plugged:5e80f502-adcb-4d34-a290-8be7965b509b for instance 262a2182-82a6-40df-9c4e-e3b094d8770e on hv-cinder-80186 Jul 22 22:15:53.899901 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-574a21b8-b6db-4da8-a616-bde745de1f78 req-296c8567-435f-4ef4-82bc-e36c053bf00e service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038498 Jul 22 22:15:53.900807 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 153/308] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:15:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:15:54.092692 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d9a172a7-8443-4a27-a908-d23c1a167feb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:54.095530 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d9a172a7-8443-4a27-a908-d23c1a167feb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:54.107288 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d9a172a7-8443-4a27-a908-d23c1a167feb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:54.108852 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d9a172a7-8443-4a27-a908-d23c1a167feb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:54.111584 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d9a172a7-8443-4a27-a908-d23c1a167feb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:54.112645 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d9a172a7-8443-4a27-a908-d23c1a167feb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:54.380084 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-196ec339-f962-406a-97ae-48396baf32d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:54.381123 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-196ec339-f962-406a-97ae-48396baf32d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:54.392849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-196ec339-f962-406a-97ae-48396baf32d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:54.394441 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-196ec339-f962-406a-97ae-48396baf32d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:54.395393 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-196ec339-f962-406a-97ae-48396baf32d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:54.397244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-196ec339-f962-406a-97ae-48396baf32d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:54.639465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d9a172a7-8443-4a27-a908-d23c1a167feb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 31206 microversion: 2.20 time: 0.553465 Jul 22 22:15:54.644784 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 156/309] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:54 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 31206 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:54.649092 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bd51ca5c-f0e9-4d08-8f0d-195537c14c70 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:54.649677 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bd51ca5c-f0e9-4d08-8f0d-195537c14c70 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:54.658928 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd51ca5c-f0e9-4d08-8f0d-195537c14c70 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:54.659514 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd51ca5c-f0e9-4d08-8f0d-195537c14c70 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:54.660413 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd51ca5c-f0e9-4d08-8f0d-195537c14c70 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:54.660625 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bd51ca5c-f0e9-4d08-8f0d-195537c14c70 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:54.740623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-196ec339-f962-406a-97ae-48396baf32d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:54.748348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-196ec339-f962-406a-97ae-48396baf32d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1325 microversion: 2.1 time: 0.372230 Jul 22 22:15:54.749221 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 154/310] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:54 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1325 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:54.804396 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-79e2bee2-a059-47df-99ab-4b7132235747 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:54.805108 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-79e2bee2-a059-47df-99ab-4b7132235747 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:54.814229 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79e2bee2-a059-47df-99ab-4b7132235747 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:54.814670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79e2bee2-a059-47df-99ab-4b7132235747 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:54.815626 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79e2bee2-a059-47df-99ab-4b7132235747 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:54.816067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-79e2bee2-a059-47df-99ab-4b7132235747 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:55.057556 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bd51ca5c-f0e9-4d08-8f0d-195537c14c70 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 31737 microversion: 2.1 time: 0.412958 Jul 22 22:15:55.058203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 157/311] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:54 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 31737 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:55.280488 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-79e2bee2-a059-47df-99ab-4b7132235747 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:55.289003 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-79e2bee2-a059-47df-99ab-4b7132235747 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.488623 Jul 22 22:15:55.289785 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 155/312] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:54 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:55.467540 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c91548c3-97bb-4d7a-ae25-63d85d28c4fc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3be8e91-2c8d-4a3b-92cc-c56358164ad8"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:55.468777 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c91548c3-97bb-4d7a-ae25-63d85d28c4fc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:55.476030 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c91548c3-97bb-4d7a-ae25-63d85d28c4fc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:55.477165 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c91548c3-97bb-4d7a-ae25-63d85d28c4fc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:55.477939 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c91548c3-97bb-4d7a-ae25-63d85d28c4fc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:55.478492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c91548c3-97bb-4d7a-ae25-63d85d28c4fc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:55.652635 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-90af1b9c-a00c-4da5-b1b5-7c87c757b154 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:55.653852 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-90af1b9c-a00c-4da5-b1b5-7c87c757b154 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:55.661394 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-90af1b9c-a00c-4da5-b1b5-7c87c757b154 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:55.662539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-90af1b9c-a00c-4da5-b1b5-7c87c757b154 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:55.663357 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-90af1b9c-a00c-4da5-b1b5-7c87c757b154 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:55.663961 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-90af1b9c-a00c-4da5-b1b5-7c87c757b154 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:56.345951 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-90af1b9c-a00c-4da5-b1b5-7c87c757b154 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 32771 microversion: 2.20 time: 0.696767 Jul 22 22:15:56.352514 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 156/313] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:55 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 32771 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:15:56.358527 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a5483a56-ac80-42e4-9170-5bd3474e8e42 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:56.359588 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a5483a56-ac80-42e4-9170-5bd3474e8e42 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:56.368599 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a5483a56-ac80-42e4-9170-5bd3474e8e42 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:56.369228 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a5483a56-ac80-42e4-9170-5bd3474e8e42 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:56.370436 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a5483a56-ac80-42e4-9170-5bd3474e8e42 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:56.371036 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a5483a56-ac80-42e4-9170-5bd3474e8e42 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:56.566152 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c91548c3-97bb-4d7a-ae25-63d85d28c4fc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "POST /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.103167 Jul 22 22:15:56.573632 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 158/314] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:15:55 2021] POST /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b/os-volume_attachments => generated 194 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:15:56.581692 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-580e6d92-cc29-446c-85bd-2a32c8d22062 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:56.583735 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-580e6d92-cc29-446c-85bd-2a32c8d22062 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:56.601888 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-580e6d92-cc29-446c-85bd-2a32c8d22062 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:56.603162 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-580e6d92-cc29-446c-85bd-2a32c8d22062 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:56.604682 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-580e6d92-cc29-446c-85bd-2a32c8d22062 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:56.605422 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-580e6d92-cc29-446c-85bd-2a32c8d22062 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:56.757991 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a5483a56-ac80-42e4-9170-5bd3474e8e42 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:56.770699 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a5483a56-ac80-42e4-9170-5bd3474e8e42 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1519 microversion: 2.1 time: 0.416602 Jul 22 22:15:56.771510 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 157/315] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:56 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:56.786160 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-54ee7a3e-ed72-428a-aec5-d6e5242a2862 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:56.786776 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-54ee7a3e-ed72-428a-aec5-d6e5242a2862 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:56.794097 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54ee7a3e-ed72-428a-aec5-d6e5242a2862 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:56.794760 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54ee7a3e-ed72-428a-aec5-d6e5242a2862 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:56.795882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54ee7a3e-ed72-428a-aec5-d6e5242a2862 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:56.796483 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54ee7a3e-ed72-428a-aec5-d6e5242a2862 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:56.911161 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-580e6d92-cc29-446c-85bd-2a32c8d22062 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 32332 microversion: 2.1 time: 0.335556 Jul 22 22:15:56.912662 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 159/316] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:56 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 32332 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:56.918130 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c5029383-d0fd-42f1-a2b3-5c73825b75ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:56.919322 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c5029383-d0fd-42f1-a2b3-5c73825b75ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:56.929003 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c5029383-d0fd-42f1-a2b3-5c73825b75ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:56.929702 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c5029383-d0fd-42f1-a2b3-5c73825b75ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:56.930658 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c5029383-d0fd-42f1-a2b3-5c73825b75ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:56.931259 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c5029383-d0fd-42f1-a2b3-5c73825b75ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:56.965566 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.objects.instance [None req-c5029383-d0fd-42f1-a2b3-5c73825b75ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lazy-loading 'flavor' on Instance uuid 2b32a316-01f1-4ac2-9c15-708742d4afac {{(pid=107498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:15:57.091371 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c5029383-d0fd-42f1-a2b3-5c73825b75ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "POST /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac/action" status: 200 len: 32 microversion: 2.1 time: 0.178140 Jul 22 22:15:57.092394 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 160/317] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:56 2021] POST /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:15:57.102696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-240aeca8-17f7-4a7e-9b04-6aa1439eb793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:57.103480 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-240aeca8-17f7-4a7e-9b04-6aa1439eb793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:57.110241 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-240aeca8-17f7-4a7e-9b04-6aa1439eb793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:57.110692 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-240aeca8-17f7-4a7e-9b04-6aa1439eb793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:57.111551 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-240aeca8-17f7-4a7e-9b04-6aa1439eb793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:57.111988 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-240aeca8-17f7-4a7e-9b04-6aa1439eb793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:57.125708 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-54ee7a3e-ed72-428a-aec5-d6e5242a2862 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:57.134562 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-54ee7a3e-ed72-428a-aec5-d6e5242a2862 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.355107 Jul 22 22:15:57.145843 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 158/318] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:56 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:57.294947 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-240aeca8-17f7-4a7e-9b04-6aa1439eb793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:57.303422 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-240aeca8-17f7-4a7e-9b04-6aa1439eb793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.204998 Jul 22 22:15:57.304179 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 161/319] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:57 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:57.361317 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c57a77a4-6e5e-40be-abc6-a71d9595a064 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:57.362875 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c57a77a4-6e5e-40be-abc6-a71d9595a064 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:57.369456 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c57a77a4-6e5e-40be-abc6-a71d9595a064 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:57.369906 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c57a77a4-6e5e-40be-abc6-a71d9595a064 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:57.370722 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c57a77a4-6e5e-40be-abc6-a71d9595a064 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:57.371157 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c57a77a4-6e5e-40be-abc6-a71d9595a064 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:57.675371 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c57a77a4-6e5e-40be-abc6-a71d9595a064 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 33106 microversion: 2.20 time: 0.318782 Jul 22 22:15:57.676182 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 159/320] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:57 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 33106 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:15:57.923352 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-12f8f370-f2b8-4b7c-8722-3c0a2331c5a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:57.924552 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-12f8f370-f2b8-4b7c-8722-3c0a2331c5a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:57.931726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-12f8f370-f2b8-4b7c-8722-3c0a2331c5a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:57.932170 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-12f8f370-f2b8-4b7c-8722-3c0a2331c5a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:57.933077 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-12f8f370-f2b8-4b7c-8722-3c0a2331c5a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:57.933515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-12f8f370-f2b8-4b7c-8722-3c0a2331c5a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:58.157019 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3b907c5a-dc47-40ba-afb1-8be75c4a24f7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:58.158502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3b907c5a-dc47-40ba-afb1-8be75c4a24f7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:58.186109 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b907c5a-dc47-40ba-afb1-8be75c4a24f7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:58.187879 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b907c5a-dc47-40ba-afb1-8be75c4a24f7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:58.189246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b907c5a-dc47-40ba-afb1-8be75c4a24f7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:58.190101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b907c5a-dc47-40ba-afb1-8be75c4a24f7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:58.220867 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-12f8f370-f2b8-4b7c-8722-3c0a2331c5a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 32609 microversion: 2.1 time: 0.301099 Jul 22 22:15:58.222680 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 162/321] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:57 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 32609 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:58.321825 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9a1f93bf-b636-46cc-8caf-17bc940afc69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:58.322813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9a1f93bf-b636-46cc-8caf-17bc940afc69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:58.337169 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9a1f93bf-b636-46cc-8caf-17bc940afc69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:58.339562 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9a1f93bf-b636-46cc-8caf-17bc940afc69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:58.350420 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9a1f93bf-b636-46cc-8caf-17bc940afc69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:58.353326 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9a1f93bf-b636-46cc-8caf-17bc940afc69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:58.550063 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3b907c5a-dc47-40ba-afb1-8be75c4a24f7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:58.581623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3b907c5a-dc47-40ba-afb1-8be75c4a24f7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.430805 Jul 22 22:15:58.595562 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 160/322] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:58 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:15:58.614465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9a1f93bf-b636-46cc-8caf-17bc940afc69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:58.625740 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9a1f93bf-b636-46cc-8caf-17bc940afc69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.308413 Jul 22 22:15:58.628660 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 163/323] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:58 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:58.689717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-10992726-7754-4b69-9372-84b7c45d61c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:58.690657 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-10992726-7754-4b69-9372-84b7c45d61c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:58.697468 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10992726-7754-4b69-9372-84b7c45d61c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:58.697983 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10992726-7754-4b69-9372-84b7c45d61c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:58.698773 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10992726-7754-4b69-9372-84b7c45d61c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:58.699228 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10992726-7754-4b69-9372-84b7c45d61c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:59.172344 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-10992726-7754-4b69-9372-84b7c45d61c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 33457 microversion: 2.20 time: 0.486789 Jul 22 22:15:59.173372 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 161/324] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:15:58 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 33457 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:15:59.236677 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8318e07e-fad4-406b-9e86-f296095b49a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:15:59.237783 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8318e07e-fad4-406b-9e86-f296095b49a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:59.244356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8318e07e-fad4-406b-9e86-f296095b49a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:59.244809 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8318e07e-fad4-406b-9e86-f296095b49a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:59.245757 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8318e07e-fad4-406b-9e86-f296095b49a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:59.246198 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8318e07e-fad4-406b-9e86-f296095b49a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:59.601550 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-65fa3eec-df7b-4913-9046-fa3918efc126 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:59.602170 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-65fa3eec-df7b-4913-9046-fa3918efc126 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:59.608765 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65fa3eec-df7b-4913-9046-fa3918efc126 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:59.609283 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65fa3eec-df7b-4913-9046-fa3918efc126 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:59.610079 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65fa3eec-df7b-4913-9046-fa3918efc126 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:59.610517 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65fa3eec-df7b-4913-9046-fa3918efc126 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:59.909407 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-65fa3eec-df7b-4913-9046-fa3918efc126 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:15:59.911845 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8318e07e-fad4-406b-9e86-f296095b49a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 32914 microversion: 2.1 time: 0.679264 Jul 22 22:15:59.916231 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 164/325] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:15:59 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 32914 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:15:59.920383 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-65fa3eec-df7b-4913-9046-fa3918efc126 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1318 microversion: 2.1 time: 0.323020 Jul 22 22:15:59.921558 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 162/326] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:59 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:15:59.924654 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3898ed7e-800d-4ca3-be98-c812548817eb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:59.927511 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3898ed7e-800d-4ca3-be98-c812548817eb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:59.929472 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4bf58e5d-5dbb-46ff-9463-ddce502b22e3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:15:59.930270 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4bf58e5d-5dbb-46ff-9463-ddce502b22e3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:15:59.940245 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4bf58e5d-5dbb-46ff-9463-ddce502b22e3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:59.940740 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4bf58e5d-5dbb-46ff-9463-ddce502b22e3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:59.941552 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4bf58e5d-5dbb-46ff-9463-ddce502b22e3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:59.941994 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4bf58e5d-5dbb-46ff-9463-ddce502b22e3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:59.945766 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3898ed7e-800d-4ca3-be98-c812548817eb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:59.956749 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3898ed7e-800d-4ca3-be98-c812548817eb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:15:59.957888 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3898ed7e-800d-4ca3-be98-c812548817eb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:15:59.959978 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3898ed7e-800d-4ca3-be98-c812548817eb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:00.283470 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3898ed7e-800d-4ca3-be98-c812548817eb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:00.297645 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3898ed7e-800d-4ca3-be98-c812548817eb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.382145 Jul 22 22:16:00.300734 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 165/327] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:59 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:00.308085 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d7c8118a-2f44-44f2-9dbc-1b379afa59a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:00.311924 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d7c8118a-2f44-44f2-9dbc-1b379afa59a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:00.324407 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7c8118a-2f44-44f2-9dbc-1b379afa59a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:00.325769 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7c8118a-2f44-44f2-9dbc-1b379afa59a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:00.328162 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7c8118a-2f44-44f2-9dbc-1b379afa59a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:00.329179 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7c8118a-2f44-44f2-9dbc-1b379afa59a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:00.357990 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4bf58e5d-5dbb-46ff-9463-ddce502b22e3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:00.367361 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4bf58e5d-5dbb-46ff-9463-ddce502b22e3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1597 microversion: 2.1 time: 0.444478 Jul 22 22:16:00.379898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 163/328] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:15:59 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1597 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:00.600426 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d7c8118a-2f44-44f2-9dbc-1b379afa59a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 34135 microversion: 2.20 time: 0.297759 Jul 22 22:16:00.604640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 166/329] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:00 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 34135 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:00.925472 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9c43f827-5d19-450d-9838-a27f1eea74c1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:00.926619 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9c43f827-5d19-450d-9838-a27f1eea74c1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:00.933540 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9c43f827-5d19-450d-9838-a27f1eea74c1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:00.934391 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9c43f827-5d19-450d-9838-a27f1eea74c1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:00.935306 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9c43f827-5d19-450d-9838-a27f1eea74c1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:00.935905 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9c43f827-5d19-450d-9838-a27f1eea74c1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:00.946810 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d139188f-1a01-4264-bb35-fd5873eabe86 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:00.950135 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d139188f-1a01-4264-bb35-fd5873eabe86 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:00.971973 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d139188f-1a01-4264-bb35-fd5873eabe86 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:00.972977 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d139188f-1a01-4264-bb35-fd5873eabe86 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:00.974532 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d139188f-1a01-4264-bb35-fd5873eabe86 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:00.975416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d139188f-1a01-4264-bb35-fd5873eabe86 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:01.199721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d139188f-1a01-4264-bb35-fd5873eabe86 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:01.225223 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9c43f827-5d19-450d-9838-a27f1eea74c1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 33140 microversion: 2.1 time: 0.304083 Jul 22 22:16:01.225888 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 164/330] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:00 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 33140 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:16:01.231478 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d139188f-1a01-4264-bb35-fd5873eabe86 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1502 microversion: 2.1 time: 0.295670 Jul 22 22:16:01.236459 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 167/331] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:00 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:01.325150 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7b45ec3a-605e-45a6-886d-d833e16e20e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:01.326351 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7b45ec3a-605e-45a6-886d-d833e16e20e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:01.339741 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b45ec3a-605e-45a6-886d-d833e16e20e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:01.342837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b45ec3a-605e-45a6-886d-d833e16e20e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:01.350476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b45ec3a-605e-45a6-886d-d833e16e20e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:01.350976 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b45ec3a-605e-45a6-886d-d833e16e20e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:01.622244 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-091a0b4f-4b9e-42b3-8c30-83d1d8ecd6d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:01.629571 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-091a0b4f-4b9e-42b3-8c30-83d1d8ecd6d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:01.637935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-091a0b4f-4b9e-42b3-8c30-83d1d8ecd6d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:01.638399 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-091a0b4f-4b9e-42b3-8c30-83d1d8ecd6d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:01.640513 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-091a0b4f-4b9e-42b3-8c30-83d1d8ecd6d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:01.641774 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-091a0b4f-4b9e-42b3-8c30-83d1d8ecd6d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:01.955488 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-091a0b4f-4b9e-42b3-8c30-83d1d8ecd6d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 34356 microversion: 2.20 time: 0.344743 Jul 22 22:16:01.961623 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 168/332] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:01 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 34356 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:02.048310 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7b45ec3a-605e-45a6-886d-d833e16e20e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:02.060771 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7b45ec3a-605e-45a6-886d-d833e16e20e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.745552 Jul 22 22:16:02.062610 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 165/333] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:01 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:02.240475 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cdbd784c-395c-489a-a58a-b0cf61ddfc14 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:02.242600 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cdbd784c-395c-489a-a58a-b0cf61ddfc14 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:02.252976 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cdbd784c-395c-489a-a58a-b0cf61ddfc14 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:02.264644 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cdbd784c-395c-489a-a58a-b0cf61ddfc14 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:02.266932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cdbd784c-395c-489a-a58a-b0cf61ddfc14 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:02.266932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cdbd784c-395c-489a-a58a-b0cf61ddfc14 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:02.552700 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cdbd784c-395c-489a-a58a-b0cf61ddfc14 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 33524 microversion: 2.1 time: 0.317404 Jul 22 22:16:02.554515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 169/334] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:02 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 33524 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:16:02.698689 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-94b7b981-f886-488c-b296-ea632066ca01 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:02.699606 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-94b7b981-f886-488c-b296-ea632066ca01 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:02.735889 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94b7b981-f886-488c-b296-ea632066ca01 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:02.736510 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94b7b981-f886-488c-b296-ea632066ca01 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:02.749692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94b7b981-f886-488c-b296-ea632066ca01 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:02.750517 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94b7b981-f886-488c-b296-ea632066ca01 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:02.853224 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-94b7b981-f886-488c-b296-ea632066ca01 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Going to try to terminate instance {{(pid=107499) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:16:02.979550 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-64cd858d-35e8-488c-ace6-4712e930cae0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:02.989899 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-64cd858d-35e8-488c-ace6-4712e930cae0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:03.025135 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-64cd858d-35e8-488c-ace6-4712e930cae0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:03.026301 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-64cd858d-35e8-488c-ace6-4712e930cae0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:03.030918 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-64cd858d-35e8-488c-ace6-4712e930cae0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:03.031421 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-64cd858d-35e8-488c-ace6-4712e930cae0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:03.106829 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-94b7b981-f886-488c-b296-ea632066ca01 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "DELETE /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 204 len: 0 microversion: 2.1 time: 0.433336 Jul 22 22:16:03.108558 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 166/335] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:16:02 2021] DELETE /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:16:03.118677 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-815c9116-c1d2-48a8-ac32-2b9710b7d7ff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:03.129090 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-815c9116-c1d2-48a8-ac32-2b9710b7d7ff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:03.140557 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-815c9116-c1d2-48a8-ac32-2b9710b7d7ff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:03.142182 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-815c9116-c1d2-48a8-ac32-2b9710b7d7ff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:03.143310 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-815c9116-c1d2-48a8-ac32-2b9710b7d7ff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:03.143989 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-815c9116-c1d2-48a8-ac32-2b9710b7d7ff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:03.456260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-64cd858d-35e8-488c-ace6-4712e930cae0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 34615 microversion: 2.20 time: 0.485278 Jul 22 22:16:03.457535 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 170/336] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:02 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 34615 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:03.471461 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-63f7c34b-bfd6-466f-bfb7-351b8f15b4cf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:03.472631 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-63f7c34b-bfd6-466f-bfb7-351b8f15b4cf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:03.520774 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-63f7c34b-bfd6-466f-bfb7-351b8f15b4cf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:03.523709 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-63f7c34b-bfd6-466f-bfb7-351b8f15b4cf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:03.524990 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-63f7c34b-bfd6-466f-bfb7-351b8f15b4cf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:03.525589 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-63f7c34b-bfd6-466f-bfb7-351b8f15b4cf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:03.697804 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-815c9116-c1d2-48a8-ac32-2b9710b7d7ff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:03.706841 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-815c9116-c1d2-48a8-ac32-2b9710b7d7ff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.596390 Jul 22 22:16:03.710281 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 167/337] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:03 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:03.727077 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4766a359-174c-44a5-a443-d87e716250d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:03.728345 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4766a359-174c-44a5-a443-d87e716250d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:03.747962 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4766a359-174c-44a5-a443-d87e716250d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:03.749783 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4766a359-174c-44a5-a443-d87e716250d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:03.761499 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4766a359-174c-44a5-a443-d87e716250d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:03.762087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4766a359-174c-44a5-a443-d87e716250d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:03.887882 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-63f7c34b-bfd6-466f-bfb7-351b8f15b4cf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:03.899891 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-63f7c34b-bfd6-466f-bfb7-351b8f15b4cf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1508 microversion: 2.1 time: 0.439855 Jul 22 22:16:03.914734 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 171/338] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:03 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1508 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:04.024717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4766a359-174c-44a5-a443-d87e716250d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 33855 microversion: 2.1 time: 0.312418 Jul 22 22:16:04.025796 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 168/339] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:03 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 33855 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:16:04.470488 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8ed2a505-1ff4-4c67-adbf-2ef26d384089 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:04.471454 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8ed2a505-1ff4-4c67-adbf-2ef26d384089 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:04.481787 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8ed2a505-1ff4-4c67-adbf-2ef26d384089 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:04.485706 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8ed2a505-1ff4-4c67-adbf-2ef26d384089 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:04.489464 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8ed2a505-1ff4-4c67-adbf-2ef26d384089 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:04.490416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8ed2a505-1ff4-4c67-adbf-2ef26d384089 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:04.728179 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5e63fa92-3287-4640-ba88-7bf819c82727 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:04.729109 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5e63fa92-3287-4640-ba88-7bf819c82727 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:04.750275 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5e63fa92-3287-4640-ba88-7bf819c82727 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:04.751506 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5e63fa92-3287-4640-ba88-7bf819c82727 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:04.752640 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5e63fa92-3287-4640-ba88-7bf819c82727 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:04.753324 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5e63fa92-3287-4640-ba88-7bf819c82727 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:04.822096 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8ed2a505-1ff4-4c67-adbf-2ef26d384089 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 34781 microversion: 2.20 time: 0.357315 Jul 22 22:16:04.823362 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 172/340] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:04 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 34781 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:04.924617 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-74648f04-b36c-456a-8653-4932a82d19f2 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:04.926715 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-74648f04-b36c-456a-8653-4932a82d19f2 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:04.941456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-74648f04-b36c-456a-8653-4932a82d19f2 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:04.942220 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-74648f04-b36c-456a-8653-4932a82d19f2 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:04.943196 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-74648f04-b36c-456a-8653-4932a82d19f2 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:04.944669 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-74648f04-b36c-456a-8653-4932a82d19f2 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:05.088337 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5e63fa92-3287-4640-ba88-7bf819c82727 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:05.104911 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5e63fa92-3287-4640-ba88-7bf819c82727 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.380944 Jul 22 22:16:05.111806 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 169/341] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:04 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:05.122442 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d45fb1fb-fe4d-4e05-af59-b23bcf96c3a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:05.123364 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d45fb1fb-fe4d-4e05-af59-b23bcf96c3a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:05.158366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d45fb1fb-fe4d-4e05-af59-b23bcf96c3a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:05.165185 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d45fb1fb-fe4d-4e05-af59-b23bcf96c3a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:05.170579 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d45fb1fb-fe4d-4e05-af59-b23bcf96c3a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:05.170928 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d45fb1fb-fe4d-4e05-af59-b23bcf96c3a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:05.448132 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d45fb1fb-fe4d-4e05-af59-b23bcf96c3a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 34226 microversion: 2.1 time: 0.334006 Jul 22 22:16:05.451921 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 170/342] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:05 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 34226 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:16:05.475578 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-b889e5c9-15da-4503-b4d3-66aa8f0b27e0 req-312bd28b-1740-49a6-b8aa-90fe3575e97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cddea8-25f9-440b-86f2-dd9c49130770", "tag": "c19590f0-00b8-4111-9a00-68a6160feb39"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:05.480473 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:16:05.480473 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:16:05.504266 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-b889e5c9-15da-4503-b4d3-66aa8f0b27e0 req-312bd28b-1740-49a6-b8aa-90fe3575e97f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:05.506443 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-b889e5c9-15da-4503-b4d3-66aa8f0b27e0 req-312bd28b-1740-49a6-b8aa-90fe3575e97f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:05.534609 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-b889e5c9-15da-4503-b4d3-66aa8f0b27e0 req-312bd28b-1740-49a6-b8aa-90fe3575e97f service nova] Creating event network-changed:c19590f0-00b8-4111-9a00-68a6160feb39 for instance e8cddea8-25f9-440b-86f2-dd9c49130770 on hv-cinder-80186 Jul 22 22:16:05.544495 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-b889e5c9-15da-4503-b4d3-66aa8f0b27e0 req-312bd28b-1740-49a6-b8aa-90fe3575e97f service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089159 Jul 22 22:16:05.548693 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 171/343] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:16:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:16:05.633536 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-74648f04-b36c-456a-8653-4932a82d19f2 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:05.646159 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-74648f04-b36c-456a-8653-4932a82d19f2 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1508 microversion: 2.1 time: 0.725922 Jul 22 22:16:05.650058 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 173/344] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:04 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1508 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:05.835098 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ef2efebf-6fca-45ab-b90e-f05c3d1ed1f0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:05.836740 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ef2efebf-6fca-45ab-b90e-f05c3d1ed1f0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:05.854777 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ef2efebf-6fca-45ab-b90e-f05c3d1ed1f0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:05.855235 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ef2efebf-6fca-45ab-b90e-f05c3d1ed1f0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:05.856054 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ef2efebf-6fca-45ab-b90e-f05c3d1ed1f0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:05.856514 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ef2efebf-6fca-45ab-b90e-f05c3d1ed1f0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:06.150793 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ef2efebf-6fca-45ab-b90e-f05c3d1ed1f0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 35106 microversion: 2.20 time: 0.319767 Jul 22 22:16:06.157036 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 172/345] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:05 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 35106 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:06.174499 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-37096a96-85a8-4fd7-b411-a7b82f6d4af2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:06.179615 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-37096a96-85a8-4fd7-b411-a7b82f6d4af2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:06.201892 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37096a96-85a8-4fd7-b411-a7b82f6d4af2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:06.204519 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37096a96-85a8-4fd7-b411-a7b82f6d4af2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:06.206008 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37096a96-85a8-4fd7-b411-a7b82f6d4af2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:06.206707 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37096a96-85a8-4fd7-b411-a7b82f6d4af2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:06.454107 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6a1e6b15-09b0-4d32-b223-62579cc2e6a5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Action: 'create', calling method: .version_select at 0x7f7d181993a0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1673230260"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:06.500998 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-37096a96-85a8-4fd7-b411-a7b82f6d4af2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:06.507608 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6a1e6b15-09b0-4d32-b223-62579cc2e6a5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Getting quotas for project 853ea27311ea40e185ea767354f4dec1. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:16:06.510719 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-37096a96-85a8-4fd7-b411-a7b82f6d4af2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.351965 Jul 22 22:16:06.511316 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 173/346] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:06 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:06.523698 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6a1e6b15-09b0-4d32-b223-62579cc2e6a5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Getting quotas for user 4af694abdd744df1beb130211b80774a and project 853ea27311ea40e185ea767354f4dec1. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:16:06.529941 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5abc016c-410c-4bd3-b37d-9e1e0ab25cf5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:06.533539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5abc016c-410c-4bd3-b37d-9e1e0ab25cf5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:06.541730 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5abc016c-410c-4bd3-b37d-9e1e0ab25cf5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:06.542313 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5abc016c-410c-4bd3-b37d-9e1e0ab25cf5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:06.544130 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5abc016c-410c-4bd3-b37d-9e1e0ab25cf5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:06.546759 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5abc016c-410c-4bd3-b37d-9e1e0ab25cf5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:06.813418 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5abc016c-410c-4bd3-b37d-9e1e0ab25cf5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 34790 microversion: 2.1 time: 0.296795 Jul 22 22:16:06.814117 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 174/347] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:06 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 34790 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:16:06.820645 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-314c1622-1944-4b95-ab9d-8714bc50e46f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:06.821362 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-314c1622-1944-4b95-ab9d-8714bc50e46f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:06.855539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-314c1622-1944-4b95-ab9d-8714bc50e46f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:06.857744 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-314c1622-1944-4b95-ab9d-8714bc50e46f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:06.862792 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-314c1622-1944-4b95-ab9d-8714bc50e46f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:06.863433 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-314c1622-1944-4b95-ab9d-8714bc50e46f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:07.112337 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-314c1622-1944-4b95-ab9d-8714bc50e46f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:07.121426 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-314c1622-1944-4b95-ab9d-8714bc50e46f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1508 microversion: 2.1 time: 0.305890 Jul 22 22:16:07.121984 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 175/348] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:06 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:07.160830 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6a1e6b15-09b0-4d32-b223-62579cc2e6a5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Getting quotas for project 853ea27311ea40e185ea767354f4dec1. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:16:07.173577 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fa94b375-3522-47cb-b5ca-96f1251be38f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:07.175003 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fa94b375-3522-47cb-b5ca-96f1251be38f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:07.185524 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fa94b375-3522-47cb-b5ca-96f1251be38f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:07.185760 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6a1e6b15-09b0-4d32-b223-62579cc2e6a5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Getting quotas for user 4af694abdd744df1beb130211b80774a and project 853ea27311ea40e185ea767354f4dec1. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:16:07.185905 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fa94b375-3522-47cb-b5ca-96f1251be38f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:07.187012 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fa94b375-3522-47cb-b5ca-96f1251be38f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:07.187599 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fa94b375-3522-47cb-b5ca-96f1251be38f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:07.202260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6a1e6b15-09b0-4d32-b223-62579cc2e6a5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.109969 Jul 22 22:16:07.210148 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 174/349] 10.222.0.110 () {60 vars in 1163 bytes} [Thu Jul 22 22:16:06 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:07.413541 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e74942eb-5870-4f9b-9821-76f0ce7061b0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1320368380"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:07.414519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e74942eb-5870-4f9b-9821-76f0ce7061b0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:07.425522 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e74942eb-5870-4f9b-9821-76f0ce7061b0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:07.425991 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e74942eb-5870-4f9b-9821-76f0ce7061b0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:07.426804 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e74942eb-5870-4f9b-9821-76f0ce7061b0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:07.427243 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e74942eb-5870-4f9b-9821-76f0ce7061b0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:07.553205 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fa94b375-3522-47cb-b5ca-96f1251be38f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 35427 microversion: 2.20 time: 0.389093 Jul 22 22:16:07.554410 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 176/350] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:07 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 35427 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:07.559761 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e33a892e-b5f2-4b6b-900a-afd638cf35d2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:07.560945 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e33a892e-b5f2-4b6b-900a-afd638cf35d2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:07.569705 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e33a892e-b5f2-4b6b-900a-afd638cf35d2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:07.570557 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e33a892e-b5f2-4b6b-900a-afd638cf35d2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:07.571588 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e33a892e-b5f2-4b6b-900a-afd638cf35d2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:07.572308 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e33a892e-b5f2-4b6b-900a-afd638cf35d2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:07.705779 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.network.security_group_api [None req-e74942eb-5870-4f9b-9821-76f0ce7061b0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Adding security group 88ee5899-9ada-4827-b2ff-6ac184c120bc to port c19590f0-00b8-4111-9a00-68a6160feb39 Jul 22 22:16:07.800119 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e33a892e-b5f2-4b6b-900a-afd638cf35d2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:07.809521 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e33a892e-b5f2-4b6b-900a-afd638cf35d2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.253821 Jul 22 22:16:07.810344 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 177/351] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:07 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:07.826678 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e687356f-f949-442e-ac7a-56348b498fe1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:07.828857 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e687356f-f949-442e-ac7a-56348b498fe1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:07.841178 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e687356f-f949-442e-ac7a-56348b498fe1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:07.844919 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e687356f-f949-442e-ac7a-56348b498fe1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:07.846059 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e687356f-f949-442e-ac7a-56348b498fe1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:07.846396 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e687356f-f949-442e-ac7a-56348b498fe1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:08.161881 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e687356f-f949-442e-ac7a-56348b498fe1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 35321 microversion: 2.1 time: 0.338493 Jul 22 22:16:08.168633 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 178/352] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:07 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 35321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:16:08.180031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5671d4c0-bcd4-43a8-9003-09605e3a5ccf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:08.182641 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5671d4c0-bcd4-43a8-9003-09605e3a5ccf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:08.209960 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5671d4c0-bcd4-43a8-9003-09605e3a5ccf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:08.218701 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5671d4c0-bcd4-43a8-9003-09605e3a5ccf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:08.224071 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5671d4c0-bcd4-43a8-9003-09605e3a5ccf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:08.225205 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5671d4c0-bcd4-43a8-9003-09605e3a5ccf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:08.312524 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e74942eb-5870-4f9b-9821-76f0ce7061b0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "POST /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/action" status: 202 len: 0 microversion: 2.1 time: 0.902234 Jul 22 22:16:08.316891 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 175/353] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:07 2021] POST /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/action => generated 0 bytes in 908 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:08.321950 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-995f244a-09e9-4340-aef5-63095d898fbf tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:08.322584 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-995f244a-09e9-4340-aef5-63095d898fbf tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:08.338203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-995f244a-09e9-4340-aef5-63095d898fbf tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:08.338696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-995f244a-09e9-4340-aef5-63095d898fbf tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:08.339504 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-995f244a-09e9-4340-aef5-63095d898fbf tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:08.339945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-995f244a-09e9-4340-aef5-63095d898fbf tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:08.559152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5671d4c0-bcd4-43a8-9003-09605e3a5ccf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:08.569305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5671d4c0-bcd4-43a8-9003-09605e3a5ccf tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1508 microversion: 2.1 time: 0.397192 Jul 22 22:16:08.587585 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 179/354] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:08 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1508 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:08.592604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-03667ebd-8395-4692-851a-245d68aaa74a req-913752f4-b45a-4138-833d-25afe810ce3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cddea8-25f9-440b-86f2-dd9c49130770", "tag": "c19590f0-00b8-4111-9a00-68a6160feb39"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:08.594882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:16:08.594882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:16:08.602130 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-995f244a-09e9-4340-aef5-63095d898fbf tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:08.611095 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-995f244a-09e9-4340-aef5-63095d898fbf tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1762 microversion: 2.1 time: 0.292970 Jul 22 22:16:08.616939 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 176/355] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:08 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1762 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:08.622329 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f8c211c4-da87-412a-b551-03f5cea85f6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:08.627567 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f8c211c4-da87-412a-b551-03f5cea85f6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:08.636381 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-03667ebd-8395-4692-851a-245d68aaa74a req-913752f4-b45a-4138-833d-25afe810ce3b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:08.636917 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-03667ebd-8395-4692-851a-245d68aaa74a req-913752f4-b45a-4138-833d-25afe810ce3b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:08.650352 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f8c211c4-da87-412a-b551-03f5cea85f6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:08.658276 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f8c211c4-da87-412a-b551-03f5cea85f6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:08.659338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f8c211c4-da87-412a-b551-03f5cea85f6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:08.659886 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f8c211c4-da87-412a-b551-03f5cea85f6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:08.671321 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-03667ebd-8395-4692-851a-245d68aaa74a req-913752f4-b45a-4138-833d-25afe810ce3b service nova] Creating event network-changed:c19590f0-00b8-4111-9a00-68a6160feb39 for instance e8cddea8-25f9-440b-86f2-dd9c49130770 on hv-cinder-80186 Jul 22 22:16:08.687519 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-03667ebd-8395-4692-851a-245d68aaa74a req-913752f4-b45a-4138-833d-25afe810ce3b service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095754 Jul 22 22:16:08.688212 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 180/356] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:16:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:16:08.836784 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a9e6f5e4-cae4-407a-978b-603b3ebc7d4b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:08.837855 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a9e6f5e4-cae4-407a-978b-603b3ebc7d4b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:08.852466 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9e6f5e4-cae4-407a-978b-603b3ebc7d4b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:08.853449 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9e6f5e4-cae4-407a-978b-603b3ebc7d4b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:08.854613 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9e6f5e4-cae4-407a-978b-603b3ebc7d4b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:08.859096 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9e6f5e4-cae4-407a-978b-603b3ebc7d4b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:09.036236 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f8c211c4-da87-412a-b551-03f5cea85f6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 35879 microversion: 2.20 time: 0.417454 Jul 22 22:16:09.049679 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 177/357] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:08 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 35879 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:09.177782 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3c22f61a-24fd-4e47-848e-cb5ecf5781d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:09.178948 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3c22f61a-24fd-4e47-848e-cb5ecf5781d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:09.196449 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3c22f61a-24fd-4e47-848e-cb5ecf5781d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:09.196818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3c22f61a-24fd-4e47-848e-cb5ecf5781d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:09.197681 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3c22f61a-24fd-4e47-848e-cb5ecf5781d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:09.199231 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3c22f61a-24fd-4e47-848e-cb5ecf5781d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:09.565793 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3c22f61a-24fd-4e47-848e-cb5ecf5781d8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 35627 microversion: 2.1 time: 0.393348 Jul 22 22:16:09.568200 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 178/358] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:09 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 35627 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:16:09.583148 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a9e6f5e4-cae4-407a-978b-603b3ebc7d4b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:09.595292 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-192983cd-67e6-4bfa-a4c1-683621f608a1 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:09.596344 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-192983cd-67e6-4bfa-a4c1-683621f608a1 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:09.619967 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a9e6f5e4-cae4-407a-978b-603b3ebc7d4b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.779472 Jul 22 22:16:09.621903 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 181/359] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:08 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:09.631206 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-192983cd-67e6-4bfa-a4c1-683621f608a1 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:09.632020 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-192983cd-67e6-4bfa-a4c1-683621f608a1 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:09.633191 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-192983cd-67e6-4bfa-a4c1-683621f608a1 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:09.634036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-192983cd-67e6-4bfa-a4c1-683621f608a1 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:10.058355 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ad71fd3b-5a5e-47e2-b12a-a4108ee94b02 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:10.059376 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ad71fd3b-5a5e-47e2-b12a-a4108ee94b02 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:10.105856 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ad71fd3b-5a5e-47e2-b12a-a4108ee94b02 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:10.106667 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ad71fd3b-5a5e-47e2-b12a-a4108ee94b02 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:10.112790 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ad71fd3b-5a5e-47e2-b12a-a4108ee94b02 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:10.114512 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ad71fd3b-5a5e-47e2-b12a-a4108ee94b02 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:10.185606 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-192983cd-67e6-4bfa-a4c1-683621f608a1 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:10.211767 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-192983cd-67e6-4bfa-a4c1-683621f608a1 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1508 microversion: 2.1 time: 0.624333 Jul 22 22:16:10.236635 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 179/360] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:09 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1508 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:10.290108 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2bcdfa60-f1d0-4602-9d48-29da641e2847 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3be8e91-2c8d-4a3b-92cc-c56358164ad8"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:10.291393 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2bcdfa60-f1d0-4602-9d48-29da641e2847 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:10.302320 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bcdfa60-f1d0-4602-9d48-29da641e2847 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:10.303371 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bcdfa60-f1d0-4602-9d48-29da641e2847 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:10.305405 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bcdfa60-f1d0-4602-9d48-29da641e2847 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:10.307481 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bcdfa60-f1d0-4602-9d48-29da641e2847 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:10.447648 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ad71fd3b-5a5e-47e2-b12a-a4108ee94b02 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 36216 microversion: 2.20 time: 0.392387 Jul 22 22:16:10.450646 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 182/361] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:10 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 36216 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:10.457240 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-2bcdfa60-f1d0-4602-9d48-29da641e2847 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] HTTP exception thrown: Invalid volume: volume e3be8e91-2c8d-4a3b-92cc-c56358164ad8 is already attached to instances: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b Jul 22 22:16:10.457578 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2bcdfa60-f1d0-4602-9d48-29da641e2847 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Returning 400 to user: Invalid volume: volume e3be8e91-2c8d-4a3b-92cc-c56358164ad8 is already attached to instances: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:16:10.458673 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2bcdfa60-f1d0-4602-9d48-29da641e2847 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "POST /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.172483 Jul 22 22:16:10.459591 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 180/362] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:16:10 2021] POST /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b/os-volume_attachments => generated 174 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 22 22:16:10.471026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-e5172d9a-344c-43b2-89f5-88f7f3b71eb9 req-fbe89573-e0ec-4744-8e85-fefdb8d70559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262a2182-82a6-40df-9c4e-e3b094d8770e", "name": "network-vif-deleted", "tag": "5e80f502-adcb-4d34-a290-8be7965b509b"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:10.472896 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:16:10.472896 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:16:10.481150 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-e5172d9a-344c-43b2-89f5-88f7f3b71eb9 req-fbe89573-e0ec-4744-8e85-fefdb8d70559 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:10.481712 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-e5172d9a-344c-43b2-89f5-88f7f3b71eb9 req-fbe89573-e0ec-4744-8e85-fefdb8d70559 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:10.494330 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-e5172d9a-344c-43b2-89f5-88f7f3b71eb9 req-fbe89573-e0ec-4744-8e85-fefdb8d70559 service nova] Creating event network-vif-deleted:5e80f502-adcb-4d34-a290-8be7965b509b for instance 262a2182-82a6-40df-9c4e-e3b094d8770e on hv-cinder-80186 Jul 22 22:16:10.501419 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-e5172d9a-344c-43b2-89f5-88f7f3b71eb9 req-fbe89573-e0ec-4744-8e85-fefdb8d70559 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045266 Jul 22 22:16:10.502031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 183/363] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:16:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:16:10.550306 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-44df6006-ecdd-4081-8d95-e90e34aed303 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:10.550804 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-44df6006-ecdd-4081-8d95-e90e34aed303 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:10.557233 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-44df6006-ecdd-4081-8d95-e90e34aed303 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:10.557997 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-44df6006-ecdd-4081-8d95-e90e34aed303 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:10.558763 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-44df6006-ecdd-4081-8d95-e90e34aed303 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:10.559205 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-44df6006-ecdd-4081-8d95-e90e34aed303 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:10.584156 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3d291cb3-3577-4485-9bd9-f558d4ce751a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:10.587049 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3d291cb3-3577-4485-9bd9-f558d4ce751a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:10.605234 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3d291cb3-3577-4485-9bd9-f558d4ce751a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:10.606291 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3d291cb3-3577-4485-9bd9-f558d4ce751a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:10.607731 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3d291cb3-3577-4485-9bd9-f558d4ce751a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:10.609295 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3d291cb3-3577-4485-9bd9-f558d4ce751a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:10.803042 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.objects.instance [None req-44df6006-ecdd-4081-8d95-e90e34aed303 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lazy-loading 'services' on Instance uuid 4fc8f297-285c-45e7-912f-a3f64a0d4e9b {{(pid=107498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:16:10.931061 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-44df6006-ecdd-4081-8d95-e90e34aed303 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "DELETE /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b/os-volume_attachments/e3be8e91-2c8d-4a3b-92cc-c56358164ad8" status: 202 len: 0 microversion: 2.1 time: 0.384708 Jul 22 22:16:10.931891 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 181/364] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:16:10 2021] DELETE /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b/os-volume_attachments/e3be8e91-2c8d-4a3b-92cc-c56358164ad8 => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:10.948935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a2601dc4-3910-42b4-ac92-af00ecb67842 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:10.949720 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a2601dc4-3910-42b4-ac92-af00ecb67842 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:10.957756 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3d291cb3-3577-4485-9bd9-f558d4ce751a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 37150 microversion: 2.1 time: 0.381888 Jul 22 22:16:10.959010 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 184/365] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:10 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 37150 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:16:10.969373 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a2601dc4-3910-42b4-ac92-af00ecb67842 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:10.969685 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a2601dc4-3910-42b4-ac92-af00ecb67842 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:10.970708 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a2601dc4-3910-42b4-ac92-af00ecb67842 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:10.973325 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a2601dc4-3910-42b4-ac92-af00ecb67842 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:11.236938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-04898809-bd74-43ac-aeaa-18b24b410470 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:11.237747 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-04898809-bd74-43ac-aeaa-18b24b410470 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:11.252042 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-04898809-bd74-43ac-aeaa-18b24b410470 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:11.252606 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-04898809-bd74-43ac-aeaa-18b24b410470 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:11.253480 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-04898809-bd74-43ac-aeaa-18b24b410470 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:11.256154 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-04898809-bd74-43ac-aeaa-18b24b410470 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:11.299492 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-04898809-bd74-43ac-aeaa-18b24b410470 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:11.299989 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-04898809-bd74-43ac-aeaa-18b24b410470 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:11.300471 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-04898809-bd74-43ac-aeaa-18b24b410470 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lazy-loading 'fault' on Instance uuid 262a2182-82a6-40df-9c4e-e3b094d8770e {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:16:11.349448 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-04898809-bd74-43ac-aeaa-18b24b410470 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:11.357649 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-04898809-bd74-43ac-aeaa-18b24b410470 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 200 len: 1308 microversion: 2.1 time: 0.124974 Jul 22 22:16:11.364679 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 185/366] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:11 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 1308 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:11.403672 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a2601dc4-3910-42b4-ac92-af00ecb67842 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:11.412300 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a2601dc4-3910-42b4-ac92-af00ecb67842 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.478354 Jul 22 22:16:11.412884 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 182/367] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:10 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:11.461978 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d2c2ebfb-fafa-4f84-8f1d-dfa1257cf19e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:11.462884 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d2c2ebfb-fafa-4f84-8f1d-dfa1257cf19e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:11.470005 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d2c2ebfb-fafa-4f84-8f1d-dfa1257cf19e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:11.470451 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d2c2ebfb-fafa-4f84-8f1d-dfa1257cf19e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:11.471234 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d2c2ebfb-fafa-4f84-8f1d-dfa1257cf19e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:11.471752 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d2c2ebfb-fafa-4f84-8f1d-dfa1257cf19e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:11.712757 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d2c2ebfb-fafa-4f84-8f1d-dfa1257cf19e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 36645 microversion: 2.20 time: 0.254280 Jul 22 22:16:11.713450 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 186/368] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:11 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 36645 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:11.972724 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-81199b88-050d-46bf-8ecd-781c1c388dce tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:11.976047 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-81199b88-050d-46bf-8ecd-781c1c388dce tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:11.982445 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-81199b88-050d-46bf-8ecd-781c1c388dce tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:11.982895 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-81199b88-050d-46bf-8ecd-781c1c388dce tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:11.983766 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-81199b88-050d-46bf-8ecd-781c1c388dce tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:11.984737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-81199b88-050d-46bf-8ecd-781c1c388dce tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:12.247127 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-81199b88-050d-46bf-8ecd-781c1c388dce tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 37481 microversion: 2.1 time: 0.280291 Jul 22 22:16:12.247851 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 183/369] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:11 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 37481 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:16:12.376824 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9313d046-c239-4287-9501-91c9bee9467a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:12.378717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9313d046-c239-4287-9501-91c9bee9467a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: 262a2182-82a6-40df-9c4e-e3b094d8770e] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:12.385484 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9313d046-c239-4287-9501-91c9bee9467a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:12.385929 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9313d046-c239-4287-9501-91c9bee9467a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:12.386701 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9313d046-c239-4287-9501-91c9bee9467a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:12.387131 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9313d046-c239-4287-9501-91c9bee9467a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:12.401129 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-9313d046-c239-4287-9501-91c9bee9467a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] HTTP exception thrown: Instance 262a2182-82a6-40df-9c4e-e3b094d8770e could not be found. Jul 22 22:16:12.401721 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9313d046-c239-4287-9501-91c9bee9467a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Returning 404 to user: Instance 262a2182-82a6-40df-9c4e-e3b094d8770e could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:16:12.402553 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9313d046-c239-4287-9501-91c9bee9467a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e" status: 404 len: 111 microversion: 2.1 time: 0.030744 Jul 22 22:16:12.403097 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 187/370] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:12 2021] GET /compute/v2.1/servers/262a2182-82a6-40df-9c4e-e3b094d8770e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:16:12.432957 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3969f880-ef23-455f-84b5-f5f6a636fd39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:12.434111 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3969f880-ef23-455f-84b5-f5f6a636fd39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:12.442562 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3969f880-ef23-455f-84b5-f5f6a636fd39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:12.443212 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3969f880-ef23-455f-84b5-f5f6a636fd39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:12.444149 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3969f880-ef23-455f-84b5-f5f6a636fd39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:12.444777 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3969f880-ef23-455f-84b5-f5f6a636fd39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:12.515873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1392864121", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "networks": [{"uuid": "73f6a462-6d96-4362-8ffe-cbb77da56019"}]}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:12.570006 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.network.neutron [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] validate_networks() for [('73f6a462-6d96-4362-8ffe-cbb77da56019', None, None, None)] {{(pid=107499) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:16:12.587853 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3969f880-ef23-455f-84b5-f5f6a636fd39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:12.596864 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3969f880-ef23-455f-84b5-f5f6a636fd39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.170620 Jul 22 22:16:12.597446 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 184/371] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:12 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:12.725512 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6ade36be-1751-4c44-9e31-1e67d0d9ed32 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:12.726467 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6ade36be-1751-4c44-9e31-1e67d0d9ed32 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:12.733930 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6ade36be-1751-4c44-9e31-1e67d0d9ed32 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:12.734384 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6ade36be-1751-4c44-9e31-1e67d0d9ed32 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:12.735187 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6ade36be-1751-4c44-9e31-1e67d0d9ed32 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:12.735622 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6ade36be-1751-4c44-9e31-1e67d0d9ed32 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:12.917260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6ade36be-1751-4c44-9e31-1e67d0d9ed32 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 37073 microversion: 2.20 time: 0.195654 Jul 22 22:16:12.918204 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 185/372] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:12 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 37073 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:16:13.152727 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Flavor limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:16:13.153313 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Image limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:16:13.153598 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Flavor pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:16:13.153997 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Image pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:16:13.154402 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:16:13.163784 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:13.164225 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:13.165191 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:13.165618 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:13.183714 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Getting quotas for project 26d903c452a64781bf8cb22c894f6ddd. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:16:13.189282 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Getting quotas for user 15dafba37aa544fc88c36284ebab3a9d and project 26d903c452a64781bf8cb22c894f6ddd. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:16:13.203194 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Going to run 1 instances... {{(pid=107499) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:16:13.205687 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107499) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:16:13.257791 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c2a1b544-442e-4f2c-a1c5-15ba8c12a901 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.746052 Jul 22 22:16:13.259223 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 188/373] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:16:12 2021] POST /compute/v2.1/servers => generated 382 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:16:13.270683 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b842b264-c161-41c5-8410-3bba9814d81e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:13.271621 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-83d6622d-76bf-4e04-9f05-998e7e5d1017 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:13.271750 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b842b264-c161-41c5-8410-3bba9814d81e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:13.272823 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-83d6622d-76bf-4e04-9f05-998e7e5d1017 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:13.278958 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b842b264-c161-41c5-8410-3bba9814d81e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:13.279407 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b842b264-c161-41c5-8410-3bba9814d81e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:13.280998 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b842b264-c161-41c5-8410-3bba9814d81e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:13.281463 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b842b264-c161-41c5-8410-3bba9814d81e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:13.367952 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-83d6622d-76bf-4e04-9f05-998e7e5d1017 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:13.376492 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-83d6622d-76bf-4e04-9f05-998e7e5d1017 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1218 microversion: 2.1 time: 0.109704 Jul 22 22:16:13.378678 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 189/374] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:13 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:13.490833 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b842b264-c161-41c5-8410-3bba9814d81e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 38095 microversion: 2.1 time: 0.233994 Jul 22 22:16:13.493218 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 186/375] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:13 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 38095 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:16:13.614849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6ac092d0-1fd6-458f-a451-684d7c83c809 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:13.615836 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6ac092d0-1fd6-458f-a451-684d7c83c809 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:13.622463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ac092d0-1fd6-458f-a451-684d7c83c809 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:13.623006 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ac092d0-1fd6-458f-a451-684d7c83c809 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:13.624748 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ac092d0-1fd6-458f-a451-684d7c83c809 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:13.625252 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ac092d0-1fd6-458f-a451-684d7c83c809 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:13.785886 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6ac092d0-1fd6-458f-a451-684d7c83c809 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:13.794646 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6ac092d0-1fd6-458f-a451-684d7c83c809 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.183565 Jul 22 22:16:13.795364 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 190/376] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:13 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:13.930433 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4ab3f6db-812f-4b05-b441-9ecdd405e3cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:13.931419 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4ab3f6db-812f-4b05-b441-9ecdd405e3cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:13.938522 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ab3f6db-812f-4b05-b441-9ecdd405e3cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:13.938971 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ab3f6db-812f-4b05-b441-9ecdd405e3cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:13.939745 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ab3f6db-812f-4b05-b441-9ecdd405e3cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:13.940172 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ab3f6db-812f-4b05-b441-9ecdd405e3cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:14.184947 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4ab3f6db-812f-4b05-b441-9ecdd405e3cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 37643 microversion: 2.20 time: 0.257024 Jul 22 22:16:14.190499 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 187/377] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:13 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 37643 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:14.394793 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e21b9b18-b607-47ba-bf26-a24d83bbec02 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:14.395565 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e21b9b18-b607-47ba-bf26-a24d83bbec02 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:14.401843 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e21b9b18-b607-47ba-bf26-a24d83bbec02 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:14.402292 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e21b9b18-b607-47ba-bf26-a24d83bbec02 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:14.403084 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e21b9b18-b607-47ba-bf26-a24d83bbec02 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:14.403519 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e21b9b18-b607-47ba-bf26-a24d83bbec02 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:14.469922 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e21b9b18-b607-47ba-bf26-a24d83bbec02 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:14.478188 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e21b9b18-b607-47ba-bf26-a24d83bbec02 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1270 microversion: 2.1 time: 0.087042 Jul 22 22:16:14.478751 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 191/378] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:14 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:14.509157 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1ae28f46-1a60-4ed7-bbfb-de66c0c32bfa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:14.510156 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1ae28f46-1a60-4ed7-bbfb-de66c0c32bfa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:14.517082 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1ae28f46-1a60-4ed7-bbfb-de66c0c32bfa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:14.517540 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1ae28f46-1a60-4ed7-bbfb-de66c0c32bfa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:14.518339 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1ae28f46-1a60-4ed7-bbfb-de66c0c32bfa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:14.518818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1ae28f46-1a60-4ed7-bbfb-de66c0c32bfa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:14.757345 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1ae28f46-1a60-4ed7-bbfb-de66c0c32bfa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 38554 microversion: 2.1 time: 0.253956 Jul 22 22:16:14.757927 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 188/379] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:14 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 38554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:16:14.813304 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-71589909-8fbb-4130-ae39-ba0b52310c9a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:14.813913 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-71589909-8fbb-4130-ae39-ba0b52310c9a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:14.819963 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-71589909-8fbb-4130-ae39-ba0b52310c9a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:14.820439 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-71589909-8fbb-4130-ae39-ba0b52310c9a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:14.821383 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-71589909-8fbb-4130-ae39-ba0b52310c9a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:14.821811 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-71589909-8fbb-4130-ae39-ba0b52310c9a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:14.991909 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-71589909-8fbb-4130-ae39-ba0b52310c9a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:15.001353 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-71589909-8fbb-4130-ae39-ba0b52310c9a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.192203 Jul 22 22:16:15.002192 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 192/380] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:14 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:15.197821 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7b6829bd-a15e-4a58-960c-32d94ca259cc tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:15.199278 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7b6829bd-a15e-4a58-960c-32d94ca259cc tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:15.206746 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b6829bd-a15e-4a58-960c-32d94ca259cc tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:15.207320 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b6829bd-a15e-4a58-960c-32d94ca259cc tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:15.208337 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b6829bd-a15e-4a58-960c-32d94ca259cc tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:15.208942 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b6829bd-a15e-4a58-960c-32d94ca259cc tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:15.446134 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7b6829bd-a15e-4a58-960c-32d94ca259cc tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 38093 microversion: 2.20 time: 0.252285 Jul 22 22:16:15.446942 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 189/381] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:15 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 38093 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:15.497607 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b1e547bf-9d81-45ee-96ff-932b36616fe6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:15.498323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b1e547bf-9d81-45ee-96ff-932b36616fe6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:15.506943 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1e547bf-9d81-45ee-96ff-932b36616fe6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:15.507556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1e547bf-9d81-45ee-96ff-932b36616fe6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:15.508765 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1e547bf-9d81-45ee-96ff-932b36616fe6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:15.509557 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1e547bf-9d81-45ee-96ff-932b36616fe6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:15.582700 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b1e547bf-9d81-45ee-96ff-932b36616fe6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:15.591235 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b1e547bf-9d81-45ee-96ff-932b36616fe6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1276 microversion: 2.1 time: 0.097365 Jul 22 22:16:15.592666 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 193/382] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:15 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1276 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:15.770534 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b8bd92e3-a947-4148-9df4-1b0db3eb22df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:15.771788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b8bd92e3-a947-4148-9df4-1b0db3eb22df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:15.779541 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b8bd92e3-a947-4148-9df4-1b0db3eb22df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:15.780797 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b8bd92e3-a947-4148-9df4-1b0db3eb22df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:15.781718 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b8bd92e3-a947-4148-9df4-1b0db3eb22df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:15.782177 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b8bd92e3-a947-4148-9df4-1b0db3eb22df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:15.988818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b8bd92e3-a947-4148-9df4-1b0db3eb22df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 200 len: 38793 microversion: 2.1 time: 0.222463 Jul 22 22:16:15.989468 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 190/383] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:15 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 38793 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:16:15.999854 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fbbf961c-b203-47c2-b575-6aee27b8f056 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:16.000387 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fbbf961c-b203-47c2-b575-6aee27b8f056 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:16.006956 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbbf961c-b203-47c2-b575-6aee27b8f056 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:16.007403 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbbf961c-b203-47c2-b575-6aee27b8f056 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:16.008184 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbbf961c-b203-47c2-b575-6aee27b8f056 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:16.008647 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbbf961c-b203-47c2-b575-6aee27b8f056 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:16.019111 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d22e09a2-58c6-4387-a240-3bc8cddf4d39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:16.019919 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d22e09a2-58c6-4387-a240-3bc8cddf4d39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:16.028097 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d22e09a2-58c6-4387-a240-3bc8cddf4d39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:16.028405 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d22e09a2-58c6-4387-a240-3bc8cddf4d39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:16.029177 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d22e09a2-58c6-4387-a240-3bc8cddf4d39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:16.029606 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d22e09a2-58c6-4387-a240-3bc8cddf4d39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:16.039849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fbbf961c-b203-47c2-b575-6aee27b8f056 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/ips" status: 200 len: 147 microversion: 2.1 time: 0.043751 Jul 22 22:16:16.040691 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 194/384] 10.222.0.110 () {58 vars in 1253 bytes} [Thu Jul 22 22:16:15 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/ips => generated 147 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:16:16.343475 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d22e09a2-58c6-4387-a240-3bc8cddf4d39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:16.351663 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d22e09a2-58c6-4387-a240-3bc8cddf4d39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.337013 Jul 22 22:16:16.352876 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 191/385] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:16 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:16.459873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bddd5ab9-8212-40a8-9512-a73609ea112f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:16.460881 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-bddd5ab9-8212-40a8-9512-a73609ea112f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:16.467120 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bddd5ab9-8212-40a8-9512-a73609ea112f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:16.468331 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bddd5ab9-8212-40a8-9512-a73609ea112f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:16.469232 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bddd5ab9-8212-40a8-9512-a73609ea112f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:16.469663 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bddd5ab9-8212-40a8-9512-a73609ea112f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:16.608036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d4ab236c-b22b-4eb8-8bc9-674679a8161f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:16.608698 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d4ab236c-b22b-4eb8-8bc9-674679a8161f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:16.615312 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4ab236c-b22b-4eb8-8bc9-674679a8161f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:16.616143 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4ab236c-b22b-4eb8-8bc9-674679a8161f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:16.617025 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4ab236c-b22b-4eb8-8bc9-674679a8161f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:16.617807 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4ab236c-b22b-4eb8-8bc9-674679a8161f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:16.653624 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-bddd5ab9-8212-40a8-9512-a73609ea112f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 38214 microversion: 2.20 time: 0.197029 Jul 22 22:16:16.654542 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 195/386] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:16 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 38214 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:16.853887 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d4ab236c-b22b-4eb8-8bc9-674679a8161f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:16.862982 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d4ab236c-b22b-4eb8-8bc9-674679a8161f tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.258692 Jul 22 22:16:16.863634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 192/387] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:16 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:16.915534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-a7270bc9-e315-44f8-9182-b5d0d8c4a289 req-d5a0c19e-e2c8-45a1-a24c-9c3c303889c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eab294e2-ba1d-40cd-a841-f21ef6c01964", "tag": "b9faf1d1-d85d-4af6-8408-98838300af74"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:16.917263 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:16:16.917263 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:16:16.934293 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-a7270bc9-e315-44f8-9182-b5d0d8c4a289 req-d5a0c19e-e2c8-45a1-a24c-9c3c303889c8 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:16.934806 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-a7270bc9-e315-44f8-9182-b5d0d8c4a289 req-d5a0c19e-e2c8-45a1-a24c-9c3c303889c8 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:16.947310 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-a7270bc9-e315-44f8-9182-b5d0d8c4a289 req-d5a0c19e-e2c8-45a1-a24c-9c3c303889c8 service nova] Creating event network-changed:b9faf1d1-d85d-4af6-8408-98838300af74 for instance eab294e2-ba1d-40cd-a841-f21ef6c01964 on hv-cinder-80186 Jul 22 22:16:16.952099 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-a7270bc9-e315-44f8-9182-b5d0d8c4a289 req-d5a0c19e-e2c8-45a1-a24c-9c3c303889c8 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041708 Jul 22 22:16:16.952741 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 196/388] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:16:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:16:17.376190 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f220a476-0d2d-4554-a066-359270e71623 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:17.376749 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f220a476-0d2d-4554-a066-359270e71623 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:17.383016 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f220a476-0d2d-4554-a066-359270e71623 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:17.383457 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f220a476-0d2d-4554-a066-359270e71623 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:17.384216 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f220a476-0d2d-4554-a066-359270e71623 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:17.384699 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f220a476-0d2d-4554-a066-359270e71623 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:17.589084 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f220a476-0d2d-4554-a066-359270e71623 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:17.597763 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f220a476-0d2d-4554-a066-359270e71623 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.226570 Jul 22 22:16:17.598328 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 193/389] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:17 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:17.668846 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-193c3ed5-0f73-47c4-abe7-e2ed79f267df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:17.669845 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-193c3ed5-0f73-47c4-abe7-e2ed79f267df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:17.675950 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-193c3ed5-0f73-47c4-abe7-e2ed79f267df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:17.676502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-193c3ed5-0f73-47c4-abe7-e2ed79f267df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:17.677277 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-193c3ed5-0f73-47c4-abe7-e2ed79f267df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:17.677712 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-193c3ed5-0f73-47c4-abe7-e2ed79f267df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:17.880717 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ed5e6f2d-21c3-47c7-98b2-38a3dbcd68a6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:17.881382 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ed5e6f2d-21c3-47c7-98b2-38a3dbcd68a6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:17.888020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-193c3ed5-0f73-47c4-abe7-e2ed79f267df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 200 len: 38342 microversion: 2.20 time: 0.224622 Jul 22 22:16:17.888363 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ed5e6f2d-21c3-47c7-98b2-38a3dbcd68a6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:17.888791 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ed5e6f2d-21c3-47c7-98b2-38a3dbcd68a6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:17.889273 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 197/390] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:17 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 38342 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:16:17.890976 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ed5e6f2d-21c3-47c7-98b2-38a3dbcd68a6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:17.891425 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ed5e6f2d-21c3-47c7-98b2-38a3dbcd68a6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:17.899926 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-642000c4-68d1-4e2a-9adb-ee470a7f3457 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:17.900743 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-642000c4-68d1-4e2a-9adb-ee470a7f3457 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:17.907709 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-642000c4-68d1-4e2a-9adb-ee470a7f3457 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:17.908197 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-642000c4-68d1-4e2a-9adb-ee470a7f3457 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:17.909031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-642000c4-68d1-4e2a-9adb-ee470a7f3457 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:17.909475 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-642000c4-68d1-4e2a-9adb-ee470a7f3457 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:17.936798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-642000c4-68d1-4e2a-9adb-ee470a7f3457 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/ips" status: 200 len: 150 microversion: 2.20 time: 0.040469 Jul 22 22:16:17.937677 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 198/391] 10.222.0.110 () {60 vars in 1294 bytes} [Thu Jul 22 22:16:17 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:16:18.144438 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ed5e6f2d-21c3-47c7-98b2-38a3dbcd68a6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:18.154681 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ed5e6f2d-21c3-47c7-98b2-38a3dbcd68a6 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.277620 Jul 22 22:16:18.156324 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 194/392] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:17 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:18.615835 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4a651b2e-a3da-426f-84c4-a33c45c81910 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:18.616515 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4a651b2e-a3da-426f-84c4-a33c45c81910 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:18.622846 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4a651b2e-a3da-426f-84c4-a33c45c81910 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:18.623299 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4a651b2e-a3da-426f-84c4-a33c45c81910 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:18.624104 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4a651b2e-a3da-426f-84c4-a33c45c81910 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:18.624558 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4a651b2e-a3da-426f-84c4-a33c45c81910 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:18.810996 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4a651b2e-a3da-426f-84c4-a33c45c81910 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:18.819180 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4a651b2e-a3da-426f-84c4-a33c45c81910 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.207924 Jul 22 22:16:18.819771 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 199/393] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:18 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:19.172667 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-eb6c8540-3489-442c-8357-1319754d0538 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:19.173453 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-eb6c8540-3489-442c-8357-1319754d0538 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:19.184623 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eb6c8540-3489-442c-8357-1319754d0538 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:19.185075 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eb6c8540-3489-442c-8357-1319754d0538 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:19.185863 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eb6c8540-3489-442c-8357-1319754d0538 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:19.186809 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eb6c8540-3489-442c-8357-1319754d0538 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:19.341699 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-eb6c8540-3489-442c-8357-1319754d0538 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:19.351012 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-eb6c8540-3489-442c-8357-1319754d0538 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.182053 Jul 22 22:16:19.351601 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 195/394] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:19 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:19.836744 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-767bce44-3e35-424a-aea9-af1d36387860 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:19.837502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-767bce44-3e35-424a-aea9-af1d36387860 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:19.845264 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-767bce44-3e35-424a-aea9-af1d36387860 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:19.845709 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-767bce44-3e35-424a-aea9-af1d36387860 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:19.846564 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-767bce44-3e35-424a-aea9-af1d36387860 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:19.847066 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-767bce44-3e35-424a-aea9-af1d36387860 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:19.985865 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-767bce44-3e35-424a-aea9-af1d36387860 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:19.993092 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-767bce44-3e35-424a-aea9-af1d36387860 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.160141 Jul 22 22:16:19.993658 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 200/395] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:19 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:20.368600 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-53b56ae0-44e9-426b-a5cd-ba0d64a0c27b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:20.369208 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-53b56ae0-44e9-426b-a5cd-ba0d64a0c27b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:20.376376 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53b56ae0-44e9-426b-a5cd-ba0d64a0c27b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:20.377011 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53b56ae0-44e9-426b-a5cd-ba0d64a0c27b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:20.377879 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53b56ae0-44e9-426b-a5cd-ba0d64a0c27b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:20.378202 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53b56ae0-44e9-426b-a5cd-ba0d64a0c27b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:20.526035 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-53b56ae0-44e9-426b-a5cd-ba0d64a0c27b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:20.534923 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-53b56ae0-44e9-426b-a5cd-ba0d64a0c27b tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.169943 Jul 22 22:16:20.535259 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 196/396] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:20 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:21.011421 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e4883b52-76de-4c69-9b1e-f030ef5ceb94 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:21.011943 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e4883b52-76de-4c69-9b1e-f030ef5ceb94 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:21.018884 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e4883b52-76de-4c69-9b1e-f030ef5ceb94 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:21.019357 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e4883b52-76de-4c69-9b1e-f030ef5ceb94 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:21.020121 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e4883b52-76de-4c69-9b1e-f030ef5ceb94 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:21.020670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e4883b52-76de-4c69-9b1e-f030ef5ceb94 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:21.164657 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e4883b52-76de-4c69-9b1e-f030ef5ceb94 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:21.173282 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e4883b52-76de-4c69-9b1e-f030ef5ceb94 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.166265 Jul 22 22:16:21.173845 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 201/397] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:21 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:21.551360 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-17389a38-d009-446e-b486-bbb9e45b7e23 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:21.552160 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-17389a38-d009-446e-b486-bbb9e45b7e23 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:21.558487 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17389a38-d009-446e-b486-bbb9e45b7e23 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:21.558930 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17389a38-d009-446e-b486-bbb9e45b7e23 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:21.559692 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17389a38-d009-446e-b486-bbb9e45b7e23 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:21.560122 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17389a38-d009-446e-b486-bbb9e45b7e23 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:21.707286 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-17389a38-d009-446e-b486-bbb9e45b7e23 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:21.714557 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-17389a38-d009-446e-b486-bbb9e45b7e23 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.166793 Jul 22 22:16:21.715309 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 197/398] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:21 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:22.189985 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0b52a566-5334-46ab-b8cc-05ddf0325214 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:22.190603 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0b52a566-5334-46ab-b8cc-05ddf0325214 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:22.203027 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0b52a566-5334-46ab-b8cc-05ddf0325214 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:22.203395 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0b52a566-5334-46ab-b8cc-05ddf0325214 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:22.204166 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0b52a566-5334-46ab-b8cc-05ddf0325214 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:22.204646 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0b52a566-5334-46ab-b8cc-05ddf0325214 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:22.348785 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0b52a566-5334-46ab-b8cc-05ddf0325214 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:22.356323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0b52a566-5334-46ab-b8cc-05ddf0325214 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.170239 Jul 22 22:16:22.356894 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 202/399] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:22 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:22.730661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5708f1d3-00c1-41fd-991e-0aa5f7dd21f9 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:22.731554 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5708f1d3-00c1-41fd-991e-0aa5f7dd21f9 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:22.738412 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5708f1d3-00c1-41fd-991e-0aa5f7dd21f9 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:22.738864 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5708f1d3-00c1-41fd-991e-0aa5f7dd21f9 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:22.739670 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5708f1d3-00c1-41fd-991e-0aa5f7dd21f9 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:22.740078 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5708f1d3-00c1-41fd-991e-0aa5f7dd21f9 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:22.885308 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5708f1d3-00c1-41fd-991e-0aa5f7dd21f9 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:22.895253 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5708f1d3-00c1-41fd-991e-0aa5f7dd21f9 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.166847 Jul 22 22:16:22.895866 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 198/400] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:22 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:23.373986 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8336ea9a-8efe-4029-8055-822e66373391 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:23.374581 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8336ea9a-8efe-4029-8055-822e66373391 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:23.380493 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8336ea9a-8efe-4029-8055-822e66373391 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:23.380932 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8336ea9a-8efe-4029-8055-822e66373391 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:23.381690 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8336ea9a-8efe-4029-8055-822e66373391 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:23.382116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8336ea9a-8efe-4029-8055-822e66373391 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:23.535953 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8336ea9a-8efe-4029-8055-822e66373391 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:23.543711 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8336ea9a-8efe-4029-8055-822e66373391 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.173400 Jul 22 22:16:23.544300 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 203/401] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:23 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:23.910719 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2758027a-81f0-4a9d-a0f9-b153f6ed0104 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:23.911318 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2758027a-81f0-4a9d-a0f9-b153f6ed0104 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:23.917551 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2758027a-81f0-4a9d-a0f9-b153f6ed0104 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:23.918097 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2758027a-81f0-4a9d-a0f9-b153f6ed0104 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:23.918803 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2758027a-81f0-4a9d-a0f9-b153f6ed0104 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:23.919232 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2758027a-81f0-4a9d-a0f9-b153f6ed0104 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:24.067620 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2758027a-81f0-4a9d-a0f9-b153f6ed0104 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:24.074755 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2758027a-81f0-4a9d-a0f9-b153f6ed0104 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.167630 Jul 22 22:16:24.075305 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 199/402] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:23 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:24.560459 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-30996f4f-de1c-411a-b702-a239388055ca tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:24.561671 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-30996f4f-de1c-411a-b702-a239388055ca tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:24.567596 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-30996f4f-de1c-411a-b702-a239388055ca tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:24.568040 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-30996f4f-de1c-411a-b702-a239388055ca tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:24.568836 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-30996f4f-de1c-411a-b702-a239388055ca tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:24.569269 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-30996f4f-de1c-411a-b702-a239388055ca tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:24.708254 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-30996f4f-de1c-411a-b702-a239388055ca tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:24.715578 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-30996f4f-de1c-411a-b702-a239388055ca tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.158814 Jul 22 22:16:24.716162 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 204/403] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:24 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:25.091598 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1f5940f3-58b0-4c17-b327-9b99bcebbf3c tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:25.092220 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1f5940f3-58b0-4c17-b327-9b99bcebbf3c tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:25.100041 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1f5940f3-58b0-4c17-b327-9b99bcebbf3c tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:25.100530 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1f5940f3-58b0-4c17-b327-9b99bcebbf3c tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:25.101305 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1f5940f3-58b0-4c17-b327-9b99bcebbf3c tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:25.101739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1f5940f3-58b0-4c17-b327-9b99bcebbf3c tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:25.243481 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1f5940f3-58b0-4c17-b327-9b99bcebbf3c tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:25.252075 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1f5940f3-58b0-4c17-b327-9b99bcebbf3c tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.164018 Jul 22 22:16:25.252674 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 200/404] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:25 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:25.732293 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-61b5a041-9b53-48d4-b360-88f5f99bec4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:25.732907 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-61b5a041-9b53-48d4-b360-88f5f99bec4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:25.739354 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-61b5a041-9b53-48d4-b360-88f5f99bec4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:25.739799 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-61b5a041-9b53-48d4-b360-88f5f99bec4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:25.740732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-61b5a041-9b53-48d4-b360-88f5f99bec4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:25.741170 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-61b5a041-9b53-48d4-b360-88f5f99bec4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:25.882442 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-61b5a041-9b53-48d4-b360-88f5f99bec4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:25.891292 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-61b5a041-9b53-48d4-b360-88f5f99bec4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.162375 Jul 22 22:16:25.891943 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 205/405] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:25 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:26.269111 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-432bd568-925e-434d-bd06-f10df8eb87c8 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:26.269725 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-432bd568-925e-434d-bd06-f10df8eb87c8 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:26.275631 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-432bd568-925e-434d-bd06-f10df8eb87c8 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:26.276083 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-432bd568-925e-434d-bd06-f10df8eb87c8 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:26.276877 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-432bd568-925e-434d-bd06-f10df8eb87c8 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:26.277318 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-432bd568-925e-434d-bd06-f10df8eb87c8 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:26.415634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-432bd568-925e-434d-bd06-f10df8eb87c8 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:26.425064 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-432bd568-925e-434d-bd06-f10df8eb87c8 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.159110 Jul 22 22:16:26.426211 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 201/406] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:26 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:26.913732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1e81c66f-1518-4b78-ba68-3c3c0834a804 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:26.914365 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1e81c66f-1518-4b78-ba68-3c3c0834a804 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:26.921677 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1e81c66f-1518-4b78-ba68-3c3c0834a804 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:26.922131 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1e81c66f-1518-4b78-ba68-3c3c0834a804 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:26.923138 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1e81c66f-1518-4b78-ba68-3c3c0834a804 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:26.923748 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1e81c66f-1518-4b78-ba68-3c3c0834a804 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:27.075154 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1e81c66f-1518-4b78-ba68-3c3c0834a804 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:27.083357 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1e81c66f-1518-4b78-ba68-3c3c0834a804 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.173381 Jul 22 22:16:27.084001 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 206/407] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:26 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:27.447757 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-04887690-1feb-47af-b8e5-56508d3b786a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:27.448415 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-04887690-1feb-47af-b8e5-56508d3b786a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:27.455177 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04887690-1feb-47af-b8e5-56508d3b786a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:27.455621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04887690-1feb-47af-b8e5-56508d3b786a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:27.456411 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04887690-1feb-47af-b8e5-56508d3b786a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:27.456874 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04887690-1feb-47af-b8e5-56508d3b786a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:27.649511 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-04887690-1feb-47af-b8e5-56508d3b786a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:27.657597 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-04887690-1feb-47af-b8e5-56508d3b786a tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.213550 Jul 22 22:16:27.658163 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 202/408] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:27 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:28.100762 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fb89490b-7c97-4f62-9398-363b9f5f3aad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:28.101399 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fb89490b-7c97-4f62-9398-363b9f5f3aad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:28.107788 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fb89490b-7c97-4f62-9398-363b9f5f3aad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:28.108809 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fb89490b-7c97-4f62-9398-363b9f5f3aad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:28.109798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fb89490b-7c97-4f62-9398-363b9f5f3aad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:28.110390 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fb89490b-7c97-4f62-9398-363b9f5f3aad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:28.313904 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fb89490b-7c97-4f62-9398-363b9f5f3aad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:28.322295 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fb89490b-7c97-4f62-9398-363b9f5f3aad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.225260 Jul 22 22:16:28.333470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 207/409] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:28 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:28.358829 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fc96eb1d-063d-4996-97fb-e39adef037b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfce17e8-b236-42f0-8b61-6264a28db7df"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:28.360142 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fc96eb1d-063d-4996-97fb-e39adef037b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:28.366771 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc96eb1d-063d-4996-97fb-e39adef037b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:28.367516 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc96eb1d-063d-4996-97fb-e39adef037b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:28.368737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc96eb1d-063d-4996-97fb-e39adef037b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:28.369855 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc96eb1d-063d-4996-97fb-e39adef037b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:28.677068 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-03e4f2e4-ce3a-4a9f-a666-1a2453da854d tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:28.677576 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-03e4f2e4-ce3a-4a9f-a666-1a2453da854d tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:28.683791 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03e4f2e4-ce3a-4a9f-a666-1a2453da854d tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:28.684225 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03e4f2e4-ce3a-4a9f-a666-1a2453da854d tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:28.685020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03e4f2e4-ce3a-4a9f-a666-1a2453da854d tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:28.685444 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03e4f2e4-ce3a-4a9f-a666-1a2453da854d tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:28.806837 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fc96eb1d-063d-4996-97fb-e39adef037b4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452764 Jul 22 22:16:28.808138 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 203/410] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:16:28 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/os-volume_attachments => generated 194 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:16:28.833585 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-03e4f2e4-ce3a-4a9f-a666-1a2453da854d tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:28.841200 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-03e4f2e4-ce3a-4a9f-a666-1a2453da854d tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.167868 Jul 22 22:16:28.842086 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 208/411] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:28 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:29.295600 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1045322352", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "networks": [{"uuid": "2efa360b-cc3d-49e4-a8a0-1edcaa3e915e"}]}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:29.338628 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-24d0052e-58d8-43f5-a0c8-b82818ecf0e2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:29.339282 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-24d0052e-58d8-43f5-a0c8-b82818ecf0e2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:29.346348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24d0052e-58d8-43f5-a0c8-b82818ecf0e2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:29.346674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24d0052e-58d8-43f5-a0c8-b82818ecf0e2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:29.347464 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24d0052e-58d8-43f5-a0c8-b82818ecf0e2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:29.347910 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24d0052e-58d8-43f5-a0c8-b82818ecf0e2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:29.352640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.network.neutron [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] validate_networks() for [('2efa360b-cc3d-49e4-a8a0-1edcaa3e915e', None, None, None)] {{(pid=107498) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:16:29.510164 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-24d0052e-58d8-43f5-a0c8-b82818ecf0e2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:29.520521 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-24d0052e-58d8-43f5-a0c8-b82818ecf0e2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.185295 Jul 22 22:16:29.521686 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 209/412] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:29 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:29.526855 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-76f87498-0579-430b-b471-5c1b8bae7eb6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:29.527391 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-76f87498-0579-430b-b471-5c1b8bae7eb6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:29.535733 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76f87498-0579-430b-b471-5c1b8bae7eb6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:29.536244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76f87498-0579-430b-b471-5c1b8bae7eb6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:29.537543 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76f87498-0579-430b-b471-5c1b8bae7eb6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:29.538178 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76f87498-0579-430b-b471-5c1b8bae7eb6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:29.563357 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-76f87498-0579-430b-b471-5c1b8bae7eb6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lazy-loading 'flavor' on Instance uuid 61e7dd91-3f55-48c9-85aa-84c2450719f2 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:16:29.794501 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Flavor limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:16:29.795096 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Image limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:16:29.795603 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Flavor pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:16:29.796007 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Image pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:16:29.796562 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:16:29.806616 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:29.807233 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:29.808701 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:29.808987 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:29.828523 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Getting quotas for project 71bffb8e6c93437cb3fdbc82d8300750. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:16:29.835050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Getting quotas for user 7438b1d834bd4e5f91ae4169e6b3a543 and project 71bffb8e6c93437cb3fdbc82d8300750. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:16:29.849141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Going to run 1 instances... {{(pid=107498) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:16:29.853061 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:16:29.884310 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-76f87498-0579-430b-b471-5c1b8bae7eb6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 202 len: 0 microversion: 2.20 time: 0.360890 Jul 22 22:16:29.890439 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 210/413] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:16:29 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:16:29.904363 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c262313e-6d4a-483c-a3c0-7047503216aa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:29.905716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c262313e-6d4a-483c-a3c0-7047503216aa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:29.919942 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c262313e-6d4a-483c-a3c0-7047503216aa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:29.921058 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c262313e-6d4a-483c-a3c0-7047503216aa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:29.922574 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c262313e-6d4a-483c-a3c0-7047503216aa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:29.924200 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c262313e-6d4a-483c-a3c0-7047503216aa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:29.939099 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0cfecd5f-b4e2-4269-9af5-f247844cfce8 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.647494 Jul 22 22:16:29.940310 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 204/414] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:16:29 2021] POST /compute/v2.1/servers => generated 382 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 22 22:16:29.948526 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-3e5f0379-f2cb-4c22-a068-c718c676a7c2 req-7d87a7fd-dbb3-4018-b0a0-ddf7f15789bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab294e2-ba1d-40cd-a841-f21ef6c01964", "name": "network-vif-plugged", "status": "completed", "tag": "b9faf1d1-d85d-4af6-8408-98838300af74"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:29.950133 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:16:29.950133 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:16:29.958853 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-3e5f0379-f2cb-4c22-a068-c718c676a7c2 req-7d87a7fd-dbb3-4018-b0a0-ddf7f15789bf service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:29.959760 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-3e5f0379-f2cb-4c22-a068-c718c676a7c2 req-7d87a7fd-dbb3-4018-b0a0-ddf7f15789bf service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:29.971123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-3e5f0379-f2cb-4c22-a068-c718c676a7c2 req-7d87a7fd-dbb3-4018-b0a0-ddf7f15789bf service nova] Creating event network-vif-plugged:b9faf1d1-d85d-4af6-8408-98838300af74 for instance eab294e2-ba1d-40cd-a841-f21ef6c01964 on hv-cinder-80186 Jul 22 22:16:29.976604 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-3e5f0379-f2cb-4c22-a068-c718c676a7c2 req-7d87a7fd-dbb3-4018-b0a0-ddf7f15789bf service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035502 Jul 22 22:16:29.977210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 205/415] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:16:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:16:29.983935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cc54c1e3-bd83-4e5c-a600-b71a27c0ce16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:29.984880 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cc54c1e3-bd83-4e5c-a600-b71a27c0ce16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:29.991418 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc54c1e3-bd83-4e5c-a600-b71a27c0ce16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:29.991945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc54c1e3-bd83-4e5c-a600-b71a27c0ce16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:29.992819 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc54c1e3-bd83-4e5c-a600-b71a27c0ce16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:29.993316 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc54c1e3-bd83-4e5c-a600-b71a27c0ce16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:30.103177 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c262313e-6d4a-483c-a3c0-7047503216aa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:30.111895 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c262313e-6d4a-483c-a3c0-7047503216aa tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.219794 Jul 22 22:16:30.113013 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 211/416] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:29 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:30.117535 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-dc6648b5-6b1a-40e8-bc48-3af805e5cf90 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:30.118135 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-dc6648b5-6b1a-40e8-bc48-3af805e5cf90 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:30.147163 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cc54c1e3-bd83-4e5c-a600-b71a27c0ce16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:30.156231 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cc54c1e3-bd83-4e5c-a600-b71a27c0ce16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:30.157938 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cc54c1e3-bd83-4e5c-a600-b71a27c0ce16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:30.159241 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cc54c1e3-bd83-4e5c-a600-b71a27c0ce16 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.179965 Jul 22 22:16:30.159879 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 206/417] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:29 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:30.190390 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-dc6648b5-6b1a-40e8-bc48-3af805e5cf90 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:30.197267 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-dc6648b5-6b1a-40e8-bc48-3af805e5cf90 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1222 microversion: 2.1 time: 0.083250 Jul 22 22:16:30.198004 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 212/418] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:30 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:30.539136 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3501e3b8-08d3-4c20-a205-f5f84dea081a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:30.539812 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3501e3b8-08d3-4c20-a205-f5f84dea081a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:30.550796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3501e3b8-08d3-4c20-a205-f5f84dea081a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:30.551293 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3501e3b8-08d3-4c20-a205-f5f84dea081a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:30.552211 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3501e3b8-08d3-4c20-a205-f5f84dea081a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:30.552683 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3501e3b8-08d3-4c20-a205-f5f84dea081a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:30.699568 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3501e3b8-08d3-4c20-a205-f5f84dea081a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:30.707525 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3501e3b8-08d3-4c20-a205-f5f84dea081a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.172534 Jul 22 22:16:30.708324 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 207/419] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:30 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:31.133161 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-42698982-ac03-4b60-afdc-f675dd2419ee tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:31.133849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-42698982-ac03-4b60-afdc-f675dd2419ee tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:31.140530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-42698982-ac03-4b60-afdc-f675dd2419ee tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:31.140993 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-42698982-ac03-4b60-afdc-f675dd2419ee tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:31.141755 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-42698982-ac03-4b60-afdc-f675dd2419ee tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:31.142240 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-42698982-ac03-4b60-afdc-f675dd2419ee tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:31.178356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b318b050-e9d5-4760-988f-513a486ff261 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:31.179201 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b318b050-e9d5-4760-988f-513a486ff261 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:31.186791 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b318b050-e9d5-4760-988f-513a486ff261 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:31.187571 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b318b050-e9d5-4760-988f-513a486ff261 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:31.188411 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b318b050-e9d5-4760-988f-513a486ff261 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:31.188900 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b318b050-e9d5-4760-988f-513a486ff261 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:31.305475 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-42698982-ac03-4b60-afdc-f675dd2419ee tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:31.314488 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-42698982-ac03-4b60-afdc-f675dd2419ee tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.184862 Jul 22 22:16:31.316165 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 213/420] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:31 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:31.326563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-22be2cfa-bb23-4d58-9897-bd854329d3e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:31.327490 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-22be2cfa-bb23-4d58-9897-bd854329d3e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:31.333461 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22be2cfa-bb23-4d58-9897-bd854329d3e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:31.333908 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22be2cfa-bb23-4d58-9897-bd854329d3e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:31.334688 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22be2cfa-bb23-4d58-9897-bd854329d3e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:31.335118 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22be2cfa-bb23-4d58-9897-bd854329d3e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:31.348362 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b318b050-e9d5-4760-988f-513a486ff261 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:31.357752 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b318b050-e9d5-4760-988f-513a486ff261 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:31.360396 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b318b050-e9d5-4760-988f-513a486ff261 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:31.362680 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b318b050-e9d5-4760-988f-513a486ff261 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.186976 Jul 22 22:16:31.362680 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 208/421] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:31 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:16:31.401688 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-22be2cfa-bb23-4d58-9897-bd854329d3e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:31.409971 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-22be2cfa-bb23-4d58-9897-bd854329d3e6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1274 microversion: 2.1 time: 0.092576 Jul 22 22:16:31.410545 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 214/422] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:31 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:31.725272 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d5a9c9e1-eee3-41de-8f84-02d2da1aed26 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:31.725891 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d5a9c9e1-eee3-41de-8f84-02d2da1aed26 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:31.732257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d5a9c9e1-eee3-41de-8f84-02d2da1aed26 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:31.732739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d5a9c9e1-eee3-41de-8f84-02d2da1aed26 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:31.734569 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d5a9c9e1-eee3-41de-8f84-02d2da1aed26 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:31.735006 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d5a9c9e1-eee3-41de-8f84-02d2da1aed26 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:31.888537 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d5a9c9e1-eee3-41de-8f84-02d2da1aed26 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:31.896721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d5a9c9e1-eee3-41de-8f84-02d2da1aed26 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.175297 Jul 22 22:16:31.897297 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 209/423] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:31 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:32.330754 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-55ef37ed-4d39-40da-a266-6817fab43c18 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:32.331352 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-55ef37ed-4d39-40da-a266-6817fab43c18 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:32.337878 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55ef37ed-4d39-40da-a266-6817fab43c18 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:32.337878 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55ef37ed-4d39-40da-a266-6817fab43c18 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:32.339343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55ef37ed-4d39-40da-a266-6817fab43c18 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:32.339343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55ef37ed-4d39-40da-a266-6817fab43c18 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:32.380923 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-096eb1db-17c4-47b8-a33f-3198cbcbdd95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:32.381470 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-096eb1db-17c4-47b8-a33f-3198cbcbdd95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:32.387725 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-096eb1db-17c4-47b8-a33f-3198cbcbdd95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:32.388456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-096eb1db-17c4-47b8-a33f-3198cbcbdd95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:32.389989 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-096eb1db-17c4-47b8-a33f-3198cbcbdd95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:32.390734 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-096eb1db-17c4-47b8-a33f-3198cbcbdd95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:32.556064 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-55ef37ed-4d39-40da-a266-6817fab43c18 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:32.570919 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-55ef37ed-4d39-40da-a266-6817fab43c18 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1318 microversion: 2.1 time: 0.243808 Jul 22 22:16:32.571676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 215/424] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:32 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:32.586902 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fdcb2e22-ad96-42a4-8be3-bf2b0319c375 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:32.587604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fdcb2e22-ad96-42a4-8be3-bf2b0319c375 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:32.594933 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fdcb2e22-ad96-42a4-8be3-bf2b0319c375 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:32.595902 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fdcb2e22-ad96-42a4-8be3-bf2b0319c375 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:32.597085 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fdcb2e22-ad96-42a4-8be3-bf2b0319c375 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:32.597735 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fdcb2e22-ad96-42a4-8be3-bf2b0319c375 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:32.694431 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fdcb2e22-ad96-42a4-8be3-bf2b0319c375 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:32.702710 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fdcb2e22-ad96-42a4-8be3-bf2b0319c375 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1280 microversion: 2.1 time: 0.119025 Jul 22 22:16:32.703909 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 216/425] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:32 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:32.713499 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-096eb1db-17c4-47b8-a33f-3198cbcbdd95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:32.724089 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-096eb1db-17c4-47b8-a33f-3198cbcbdd95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:32.725859 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-096eb1db-17c4-47b8-a33f-3198cbcbdd95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:32.728313 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-096eb1db-17c4-47b8-a33f-3198cbcbdd95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.350083 Jul 22 22:16:32.729245 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 210/426] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:32 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:16:32.913215 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9bb3a509-84cb-45d6-b64b-0ee0fabcbbb5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:32.914065 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9bb3a509-84cb-45d6-b64b-0ee0fabcbbb5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:32.919870 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9bb3a509-84cb-45d6-b64b-0ee0fabcbbb5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:32.920644 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9bb3a509-84cb-45d6-b64b-0ee0fabcbbb5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:32.921407 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9bb3a509-84cb-45d6-b64b-0ee0fabcbbb5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:32.921900 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9bb3a509-84cb-45d6-b64b-0ee0fabcbbb5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:33.131116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9bb3a509-84cb-45d6-b64b-0ee0fabcbbb5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:33.141786 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9bb3a509-84cb-45d6-b64b-0ee0fabcbbb5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.232180 Jul 22 22:16:33.153546 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 217/427] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:32 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:33.588735 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-18aa79e8-0405-4e8c-93a1-2e425e4aeaf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:33.589488 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-18aa79e8-0405-4e8c-93a1-2e425e4aeaf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:33.603225 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18aa79e8-0405-4e8c-93a1-2e425e4aeaf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:33.603699 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18aa79e8-0405-4e8c-93a1-2e425e4aeaf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:33.604511 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18aa79e8-0405-4e8c-93a1-2e425e4aeaf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:33.605197 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18aa79e8-0405-4e8c-93a1-2e425e4aeaf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:33.720744 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4162e598-c161-4154-9b01-d9ac2e6449a9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:33.722303 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4162e598-c161-4154-9b01-d9ac2e6449a9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:33.728974 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4162e598-c161-4154-9b01-d9ac2e6449a9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:33.729424 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4162e598-c161-4154-9b01-d9ac2e6449a9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:33.730246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4162e598-c161-4154-9b01-d9ac2e6449a9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:33.730898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4162e598-c161-4154-9b01-d9ac2e6449a9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:33.871925 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-18aa79e8-0405-4e8c-93a1-2e425e4aeaf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:33.881985 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-18aa79e8-0405-4e8c-93a1-2e425e4aeaf3 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1502 microversion: 2.1 time: 0.296720 Jul 22 22:16:33.898283 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 211/428] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:33 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1502 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:33.913554 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ef69a803-f7bb-4cf0-aa7e-5f055a0ccc62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:33.914196 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ef69a803-f7bb-4cf0-aa7e-5f055a0ccc62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:33.940539 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef69a803-f7bb-4cf0-aa7e-5f055a0ccc62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:33.946729 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4162e598-c161-4154-9b01-d9ac2e6449a9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:33.957420 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef69a803-f7bb-4cf0-aa7e-5f055a0ccc62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:33.960735 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef69a803-f7bb-4cf0-aa7e-5f055a0ccc62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:33.961258 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef69a803-f7bb-4cf0-aa7e-5f055a0ccc62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:33.962799 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4162e598-c161-4154-9b01-d9ac2e6449a9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.244340 Jul 22 22:16:33.964503 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 218/429] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:33 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:33.972796 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-bf14eab3-bbb1-435a-9313-409b2a30f807 req-a2c238da-ac9e-4822-8128-1fbc3653387b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4e9f7e-0dbd-462c-a906-28fc0b57fa57", "tag": "92535272-b7aa-4912-9315-13139c6d3169"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:33.975053 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:16:33.975053 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:16:33.984136 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-bf14eab3-bbb1-435a-9313-409b2a30f807 req-a2c238da-ac9e-4822-8128-1fbc3653387b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:33.984869 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-bf14eab3-bbb1-435a-9313-409b2a30f807 req-a2c238da-ac9e-4822-8128-1fbc3653387b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:33.997274 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-bf14eab3-bbb1-435a-9313-409b2a30f807 req-a2c238da-ac9e-4822-8128-1fbc3653387b service nova] Creating event network-changed:92535272-b7aa-4912-9315-13139c6d3169 for instance 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 on hv-cinder-80186 Jul 22 22:16:34.003844 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-bf14eab3-bbb1-435a-9313-409b2a30f807 req-a2c238da-ac9e-4822-8128-1fbc3653387b service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036444 Jul 22 22:16:34.005126 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 219/430] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:16:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:16:34.159629 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-dfe76ac0-9e5f-4982-b4e2-fcc6fc621b70 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:34.160361 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-dfe76ac0-9e5f-4982-b4e2-fcc6fc621b70 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:34.165982 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ef69a803-f7bb-4cf0-aa7e-5f055a0ccc62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:34.171838 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dfe76ac0-9e5f-4982-b4e2-fcc6fc621b70 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:34.172317 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dfe76ac0-9e5f-4982-b4e2-fcc6fc621b70 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:34.173092 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dfe76ac0-9e5f-4982-b4e2-fcc6fc621b70 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:34.173527 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dfe76ac0-9e5f-4982-b4e2-fcc6fc621b70 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:34.175053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ef69a803-f7bb-4cf0-aa7e-5f055a0ccc62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:34.176813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ef69a803-f7bb-4cf0-aa7e-5f055a0ccc62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:34.177972 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ef69a803-f7bb-4cf0-aa7e-5f055a0ccc62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.289489 Jul 22 22:16:34.178717 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 212/431] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:33 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:34.320946 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-dfe76ac0-9e5f-4982-b4e2-fcc6fc621b70 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:34.328544 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-dfe76ac0-9e5f-4982-b4e2-fcc6fc621b70 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.173706 Jul 22 22:16:34.329530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 220/432] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:34 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:34.979824 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ce586a46-0315-48ea-9447-e7d00f6a29c0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:34.980500 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ce586a46-0315-48ea-9447-e7d00f6a29c0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:34.986615 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce586a46-0315-48ea-9447-e7d00f6a29c0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:34.987058 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce586a46-0315-48ea-9447-e7d00f6a29c0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:34.987843 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce586a46-0315-48ea-9447-e7d00f6a29c0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:34.988258 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce586a46-0315-48ea-9447-e7d00f6a29c0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:35.188892 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ce586a46-0315-48ea-9447-e7d00f6a29c0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:35.196422 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-86332b4c-1133-4707-bab2-62b866f0cc89 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:35.196422 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-86332b4c-1133-4707-bab2-62b866f0cc89 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:35.204699 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ce586a46-0315-48ea-9447-e7d00f6a29c0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.228138 Jul 22 22:16:35.205816 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 213/433] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:34 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:35.206293 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-86332b4c-1133-4707-bab2-62b866f0cc89 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:35.206695 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-86332b4c-1133-4707-bab2-62b866f0cc89 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:35.207497 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-86332b4c-1133-4707-bab2-62b866f0cc89 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:35.207927 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-86332b4c-1133-4707-bab2-62b866f0cc89 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:35.345774 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5132527b-561f-436a-8b70-4713f5fe89a7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:35.347056 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5132527b-561f-436a-8b70-4713f5fe89a7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:35.354893 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5132527b-561f-436a-8b70-4713f5fe89a7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:35.355274 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5132527b-561f-436a-8b70-4713f5fe89a7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:35.358827 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-86332b4c-1133-4707-bab2-62b866f0cc89 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:35.361733 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5132527b-561f-436a-8b70-4713f5fe89a7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:35.362180 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5132527b-561f-436a-8b70-4713f5fe89a7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:35.367436 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-86332b4c-1133-4707-bab2-62b866f0cc89 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:35.369401 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-86332b4c-1133-4707-bab2-62b866f0cc89 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:35.370623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-86332b4c-1133-4707-bab2-62b866f0cc89 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.178635 Jul 22 22:16:35.380587 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 221/434] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:35 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:16:35.457373 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-324cb484-2fb2-49c1-80e9-af307f5ad910 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:35.457868 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-324cb484-2fb2-49c1-80e9-af307f5ad910 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:35.463717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-324cb484-2fb2-49c1-80e9-af307f5ad910 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:35.464149 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-324cb484-2fb2-49c1-80e9-af307f5ad910 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:35.464938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-324cb484-2fb2-49c1-80e9-af307f5ad910 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:35.465364 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-324cb484-2fb2-49c1-80e9-af307f5ad910 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:35.493652 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-324cb484-2fb2-49c1-80e9-af307f5ad910 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Going to try to terminate instance {{(pid=107499) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:16:35.519315 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5132527b-561f-436a-8b70-4713f5fe89a7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:35.526849 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5132527b-561f-436a-8b70-4713f5fe89a7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.185077 Jul 22 22:16:35.527409 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 214/435] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:35 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:35.573178 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-324cb484-2fb2-49c1-80e9-af307f5ad910 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "DELETE /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 204 len: 0 microversion: 2.1 time: 0.119114 Jul 22 22:16:35.573777 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 222/436] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:16:35 2021] DELETE /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 22 22:16:35.582262 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-24a2b024-5b84-47eb-8def-854f7e978eb5 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:35.583108 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-24a2b024-5b84-47eb-8def-854f7e978eb5 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:35.589544 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24a2b024-5b84-47eb-8def-854f7e978eb5 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:35.590090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24a2b024-5b84-47eb-8def-854f7e978eb5 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:35.591218 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24a2b024-5b84-47eb-8def-854f7e978eb5 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:35.591733 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24a2b024-5b84-47eb-8def-854f7e978eb5 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:35.744116 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-24a2b024-5b84-47eb-8def-854f7e978eb5 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:35.752090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-24a2b024-5b84-47eb-8def-854f7e978eb5 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1508 microversion: 2.1 time: 0.173522 Jul 22 22:16:35.752695 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 215/437] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:35 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:36.223174 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-245a3a6d-94d5-456c-8837-d6ff972f6a40 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:36.224417 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-245a3a6d-94d5-456c-8837-d6ff972f6a40 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:36.230341 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-245a3a6d-94d5-456c-8837-d6ff972f6a40 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:36.230780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-245a3a6d-94d5-456c-8837-d6ff972f6a40 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:36.231575 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-245a3a6d-94d5-456c-8837-d6ff972f6a40 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:36.232014 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-245a3a6d-94d5-456c-8837-d6ff972f6a40 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:36.372871 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-245a3a6d-94d5-456c-8837-d6ff972f6a40 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:36.381272 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-245a3a6d-94d5-456c-8837-d6ff972f6a40 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.162593 Jul 22 22:16:36.381840 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 223/438] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:36 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:36.389621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0dcebef9-f158-4c71-b226-bc9f9f66b0b9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:36.390241 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0dcebef9-f158-4c71-b226-bc9f9f66b0b9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:36.396056 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dcebef9-f158-4c71-b226-bc9f9f66b0b9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:36.396564 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dcebef9-f158-4c71-b226-bc9f9f66b0b9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:36.397339 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dcebef9-f158-4c71-b226-bc9f9f66b0b9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:36.397778 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dcebef9-f158-4c71-b226-bc9f9f66b0b9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:36.534758 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0dcebef9-f158-4c71-b226-bc9f9f66b0b9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:36.544141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0dcebef9-f158-4c71-b226-bc9f9f66b0b9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:36.544404 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1cc188c2-1824-41be-9224-b532119c6878 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:36.544983 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1cc188c2-1824-41be-9224-b532119c6878 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:36.546209 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0dcebef9-f158-4c71-b226-bc9f9f66b0b9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:36.548116 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0dcebef9-f158-4c71-b226-bc9f9f66b0b9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.162314 Jul 22 22:16:36.548731 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 216/439] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:36 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:36.551945 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1cc188c2-1824-41be-9224-b532119c6878 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:36.552491 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1cc188c2-1824-41be-9224-b532119c6878 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:36.553259 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1cc188c2-1824-41be-9224-b532119c6878 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:36.553717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1cc188c2-1824-41be-9224-b532119c6878 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:36.697966 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1cc188c2-1824-41be-9224-b532119c6878 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:36.706189 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1cc188c2-1824-41be-9224-b532119c6878 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.165338 Jul 22 22:16:36.706765 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 224/440] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:36 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:36.769558 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f4c0b26f-b3bc-459c-95bd-5db31e17dfba tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:36.770085 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f4c0b26f-b3bc-459c-95bd-5db31e17dfba tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:36.775963 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f4c0b26f-b3bc-459c-95bd-5db31e17dfba tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:36.776442 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f4c0b26f-b3bc-459c-95bd-5db31e17dfba tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:36.777200 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f4c0b26f-b3bc-459c-95bd-5db31e17dfba tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:36.777633 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f4c0b26f-b3bc-459c-95bd-5db31e17dfba tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:36.916168 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f4c0b26f-b3bc-459c-95bd-5db31e17dfba tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:36.924150 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f4c0b26f-b3bc-459c-95bd-5db31e17dfba tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1508 microversion: 2.1 time: 0.158292 Jul 22 22:16:36.924823 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 217/441] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:36 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:37.398207 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-216d503e-edd5-4909-9e0b-9b1fd5d5696c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:37.398836 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-216d503e-edd5-4909-9e0b-9b1fd5d5696c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:37.404567 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-216d503e-edd5-4909-9e0b-9b1fd5d5696c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:37.405081 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-216d503e-edd5-4909-9e0b-9b1fd5d5696c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:37.405849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-216d503e-edd5-4909-9e0b-9b1fd5d5696c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:37.406271 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-216d503e-edd5-4909-9e0b-9b1fd5d5696c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:37.544323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-216d503e-edd5-4909-9e0b-9b1fd5d5696c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:37.552307 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-216d503e-edd5-4909-9e0b-9b1fd5d5696c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.157687 Jul 22 22:16:37.552874 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 225/442] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:37 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:37.567451 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9c67d0a4-860a-48b8-9e32-b1799279e326 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:37.568050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9c67d0a4-860a-48b8-9e32-b1799279e326 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:37.573826 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9c67d0a4-860a-48b8-9e32-b1799279e326 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:37.574268 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9c67d0a4-860a-48b8-9e32-b1799279e326 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:37.575022 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9c67d0a4-860a-48b8-9e32-b1799279e326 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:37.575446 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9c67d0a4-860a-48b8-9e32-b1799279e326 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:37.724060 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-704c9b94-1132-4f49-a69c-636b591703aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:37.724220 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9c67d0a4-860a-48b8-9e32-b1799279e326 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:37.724684 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-704c9b94-1132-4f49-a69c-636b591703aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:37.730520 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-704c9b94-1132-4f49-a69c-636b591703aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:37.730956 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-704c9b94-1132-4f49-a69c-636b591703aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:37.731714 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-704c9b94-1132-4f49-a69c-636b591703aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:37.731973 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9c67d0a4-860a-48b8-9e32-b1799279e326 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:37.732164 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-704c9b94-1132-4f49-a69c-636b591703aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:37.733727 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9c67d0a4-860a-48b8-9e32-b1799279e326 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:37.734868 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9c67d0a4-860a-48b8-9e32-b1799279e326 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.171058 Jul 22 22:16:37.735424 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 218/443] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:37 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:37.871265 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-704c9b94-1132-4f49-a69c-636b591703aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:37.879479 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-704c9b94-1132-4f49-a69c-636b591703aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.159777 Jul 22 22:16:37.880048 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 226/444] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:37 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:37.942558 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5daa8d58-1f3f-4bfb-8387-b82f01706157 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:37.943168 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5daa8d58-1f3f-4bfb-8387-b82f01706157 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:37.952026 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5daa8d58-1f3f-4bfb-8387-b82f01706157 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:37.952497 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5daa8d58-1f3f-4bfb-8387-b82f01706157 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:37.953282 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5daa8d58-1f3f-4bfb-8387-b82f01706157 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:37.953734 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5daa8d58-1f3f-4bfb-8387-b82f01706157 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:38.090754 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5daa8d58-1f3f-4bfb-8387-b82f01706157 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:38.098209 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5daa8d58-1f3f-4bfb-8387-b82f01706157 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1508 microversion: 2.1 time: 0.160014 Jul 22 22:16:38.099034 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 219/445] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:37 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:38.569375 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f9ccacce-93fc-4b28-8be8-ca03579e2c79 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:38.570005 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f9ccacce-93fc-4b28-8be8-ca03579e2c79 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:38.576006 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f9ccacce-93fc-4b28-8be8-ca03579e2c79 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:38.576483 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f9ccacce-93fc-4b28-8be8-ca03579e2c79 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:38.577247 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f9ccacce-93fc-4b28-8be8-ca03579e2c79 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:38.577766 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f9ccacce-93fc-4b28-8be8-ca03579e2c79 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:38.718068 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f9ccacce-93fc-4b28-8be8-ca03579e2c79 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:38.725692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f9ccacce-93fc-4b28-8be8-ca03579e2c79 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.160005 Jul 22 22:16:38.726254 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 227/446] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:38 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:38.753566 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ad9f4c84-8842-443c-b173-e3799336134a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:38.754171 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ad9f4c84-8842-443c-b173-e3799336134a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:38.760056 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ad9f4c84-8842-443c-b173-e3799336134a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:38.760527 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ad9f4c84-8842-443c-b173-e3799336134a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:38.761278 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ad9f4c84-8842-443c-b173-e3799336134a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:38.761702 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ad9f4c84-8842-443c-b173-e3799336134a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:38.896476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2edc476c-dbe8-46f2-a7ef-0cf6ae6af499 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:38.897184 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2edc476c-dbe8-46f2-a7ef-0cf6ae6af499 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:38.903276 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ad9f4c84-8842-443c-b173-e3799336134a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:38.904363 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2edc476c-dbe8-46f2-a7ef-0cf6ae6af499 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:38.906168 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2edc476c-dbe8-46f2-a7ef-0cf6ae6af499 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:38.906957 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2edc476c-dbe8-46f2-a7ef-0cf6ae6af499 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:38.907388 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2edc476c-dbe8-46f2-a7ef-0cf6ae6af499 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:38.912173 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ad9f4c84-8842-443c-b173-e3799336134a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:38.913684 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ad9f4c84-8842-443c-b173-e3799336134a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:38.914813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ad9f4c84-8842-443c-b173-e3799336134a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.164904 Jul 22 22:16:38.915358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 220/447] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:38 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:39.049627 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2edc476c-dbe8-46f2-a7ef-0cf6ae6af499 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:39.056924 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2edc476c-dbe8-46f2-a7ef-0cf6ae6af499 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.164249 Jul 22 22:16:39.057483 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 228/448] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:38 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:39.114787 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d4deb250-68f8-4eb4-bb88-00616e5b67b7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:39.115395 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d4deb250-68f8-4eb4-bb88-00616e5b67b7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:39.121302 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4deb250-68f8-4eb4-bb88-00616e5b67b7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:39.121745 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4deb250-68f8-4eb4-bb88-00616e5b67b7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:39.122504 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4deb250-68f8-4eb4-bb88-00616e5b67b7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:39.122930 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4deb250-68f8-4eb4-bb88-00616e5b67b7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:39.264918 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d4deb250-68f8-4eb4-bb88-00616e5b67b7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:39.272837 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d4deb250-68f8-4eb4-bb88-00616e5b67b7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1508 microversion: 2.1 time: 0.161803 Jul 22 22:16:39.273410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 221/449] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:39 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:39.742948 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f1e45ede-6600-4353-abfb-7a6741e6c839 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:39.743592 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f1e45ede-6600-4353-abfb-7a6741e6c839 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:39.749837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f1e45ede-6600-4353-abfb-7a6741e6c839 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:39.750278 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f1e45ede-6600-4353-abfb-7a6741e6c839 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:39.751042 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f1e45ede-6600-4353-abfb-7a6741e6c839 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:39.751478 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f1e45ede-6600-4353-abfb-7a6741e6c839 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:39.896010 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f1e45ede-6600-4353-abfb-7a6741e6c839 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:39.903382 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f1e45ede-6600-4353-abfb-7a6741e6c839 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.164186 Jul 22 22:16:39.904257 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 229/450] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:39 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:39.936682 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5b7cacbe-674e-46ea-aca2-4658a3239283 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:39.937295 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5b7cacbe-674e-46ea-aca2-4658a3239283 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:39.943475 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5b7cacbe-674e-46ea-aca2-4658a3239283 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:39.943960 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5b7cacbe-674e-46ea-aca2-4658a3239283 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:39.944771 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5b7cacbe-674e-46ea-aca2-4658a3239283 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:39.945210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5b7cacbe-674e-46ea-aca2-4658a3239283 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:40.073270 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8c9fc260-dfa0-4bf3-8d7e-4c2f3b61923d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:40.073879 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8c9fc260-dfa0-4bf3-8d7e-4c2f3b61923d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:40.080857 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c9fc260-dfa0-4bf3-8d7e-4c2f3b61923d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:40.081311 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c9fc260-dfa0-4bf3-8d7e-4c2f3b61923d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:40.082088 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c9fc260-dfa0-4bf3-8d7e-4c2f3b61923d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:40.082529 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c9fc260-dfa0-4bf3-8d7e-4c2f3b61923d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:40.082728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5b7cacbe-674e-46ea-aca2-4658a3239283 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:40.090997 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5b7cacbe-674e-46ea-aca2-4658a3239283 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:40.093252 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5b7cacbe-674e-46ea-aca2-4658a3239283 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:40.094437 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5b7cacbe-674e-46ea-aca2-4658a3239283 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.161581 Jul 22 22:16:40.094995 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 222/451] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:39 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:40.221183 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8c9fc260-dfa0-4bf3-8d7e-4c2f3b61923d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:40.229193 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8c9fc260-dfa0-4bf3-8d7e-4c2f3b61923d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.159673 Jul 22 22:16:40.229756 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 230/452] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:40 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:40.289671 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6097d119-6483-4c86-824c-4240eb79a2fd tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:40.290296 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6097d119-6483-4c86-824c-4240eb79a2fd tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:40.296214 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6097d119-6483-4c86-824c-4240eb79a2fd tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:40.296681 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6097d119-6483-4c86-824c-4240eb79a2fd tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:40.297441 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6097d119-6483-4c86-824c-4240eb79a2fd tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:40.297868 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6097d119-6483-4c86-824c-4240eb79a2fd tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:40.433120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6097d119-6483-4c86-824c-4240eb79a2fd tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:40.441651 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6097d119-6483-4c86-824c-4240eb79a2fd tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1508 microversion: 2.1 time: 0.155672 Jul 22 22:16:40.442219 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 223/453] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:40 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:40.919879 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1458b129-2228-43f4-b664-d8e14a4f55af tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:40.921203 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1458b129-2228-43f4-b664-d8e14a4f55af tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:40.928732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1458b129-2228-43f4-b664-d8e14a4f55af tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:40.929201 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1458b129-2228-43f4-b664-d8e14a4f55af tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:40.929993 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1458b129-2228-43f4-b664-d8e14a4f55af tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:40.930428 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1458b129-2228-43f4-b664-d8e14a4f55af tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:41.071696 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1458b129-2228-43f4-b664-d8e14a4f55af tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:41.079117 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1458b129-2228-43f4-b664-d8e14a4f55af tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.162869 Jul 22 22:16:41.079672 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 231/454] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:40 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:41.113734 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b8e6976c-4b67-44c9-b3bc-93b56ea874eb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:41.114344 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b8e6976c-4b67-44c9-b3bc-93b56ea874eb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:41.120205 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b8e6976c-4b67-44c9-b3bc-93b56ea874eb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:41.120687 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b8e6976c-4b67-44c9-b3bc-93b56ea874eb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:41.121454 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b8e6976c-4b67-44c9-b3bc-93b56ea874eb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:41.121975 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b8e6976c-4b67-44c9-b3bc-93b56ea874eb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:41.245595 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b7a6fb35-e49b-449a-8515-ee4803e6361e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:41.246285 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b7a6fb35-e49b-449a-8515-ee4803e6361e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:41.252506 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b7a6fb35-e49b-449a-8515-ee4803e6361e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:41.252954 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b7a6fb35-e49b-449a-8515-ee4803e6361e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:41.254502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b7a6fb35-e49b-449a-8515-ee4803e6361e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:41.254942 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b7a6fb35-e49b-449a-8515-ee4803e6361e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:41.263346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b8e6976c-4b67-44c9-b3bc-93b56ea874eb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:41.272599 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b8e6976c-4b67-44c9-b3bc-93b56ea874eb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:41.274132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b8e6976c-4b67-44c9-b3bc-93b56ea874eb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:41.275280 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b8e6976c-4b67-44c9-b3bc-93b56ea874eb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.165276 Jul 22 22:16:41.278169 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 224/455] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:41 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:41.396852 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b7a6fb35-e49b-449a-8515-ee4803e6361e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:41.405077 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b7a6fb35-e49b-449a-8515-ee4803e6361e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.162516 Jul 22 22:16:41.405882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 232/456] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:41 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:41.458500 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a4ce87b8-2cf1-4689-b08d-18d88ef7cd09 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:41.459118 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a4ce87b8-2cf1-4689-b08d-18d88ef7cd09 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:41.465298 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a4ce87b8-2cf1-4689-b08d-18d88ef7cd09 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:41.465758 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a4ce87b8-2cf1-4689-b08d-18d88ef7cd09 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:41.466546 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a4ce87b8-2cf1-4689-b08d-18d88ef7cd09 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:41.467562 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a4ce87b8-2cf1-4689-b08d-18d88ef7cd09 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:41.613609 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a4ce87b8-2cf1-4689-b08d-18d88ef7cd09 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:41.621480 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a4ce87b8-2cf1-4689-b08d-18d88ef7cd09 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1508 microversion: 2.1 time: 0.166488 Jul 22 22:16:41.622304 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 225/457] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:41 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:42.095799 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-54c033c0-b6aa-497b-b452-5e00dacfb924 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:42.096604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-54c033c0-b6aa-497b-b452-5e00dacfb924 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:42.102912 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54c033c0-b6aa-497b-b452-5e00dacfb924 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:42.103362 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54c033c0-b6aa-497b-b452-5e00dacfb924 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:42.104170 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54c033c0-b6aa-497b-b452-5e00dacfb924 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:42.104629 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-54c033c0-b6aa-497b-b452-5e00dacfb924 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:42.254662 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-54c033c0-b6aa-497b-b452-5e00dacfb924 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:42.262161 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-54c033c0-b6aa-497b-b452-5e00dacfb924 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.170418 Jul 22 22:16:42.262714 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 233/458] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:42 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:42.293814 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-da02540a-e8a3-4ca1-8d88-31ddcfa157c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:42.294490 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-da02540a-e8a3-4ca1-8d88-31ddcfa157c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:42.301025 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-da02540a-e8a3-4ca1-8d88-31ddcfa157c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:42.301469 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-da02540a-e8a3-4ca1-8d88-31ddcfa157c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:42.302250 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-da02540a-e8a3-4ca1-8d88-31ddcfa157c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:42.302686 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-da02540a-e8a3-4ca1-8d88-31ddcfa157c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:42.422760 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-49ddb086-d531-4aa0-ac83-38f26f35b8bb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:42.423208 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-49ddb086-d531-4aa0-ac83-38f26f35b8bb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:42.429859 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49ddb086-d531-4aa0-ac83-38f26f35b8bb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:42.430291 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49ddb086-d531-4aa0-ac83-38f26f35b8bb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:42.431072 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49ddb086-d531-4aa0-ac83-38f26f35b8bb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:42.431505 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49ddb086-d531-4aa0-ac83-38f26f35b8bb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:42.448032 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-da02540a-e8a3-4ca1-8d88-31ddcfa157c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:42.456532 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-da02540a-e8a3-4ca1-8d88-31ddcfa157c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:42.458030 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-da02540a-e8a3-4ca1-8d88-31ddcfa157c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:42.459360 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-da02540a-e8a3-4ca1-8d88-31ddcfa157c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.169264 Jul 22 22:16:42.459916 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 226/459] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:42 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:42.582456 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-49ddb086-d531-4aa0-ac83-38f26f35b8bb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:42.590995 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-49ddb086-d531-4aa0-ac83-38f26f35b8bb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.172652 Jul 22 22:16:42.598815 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 234/460] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:42 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:42.642718 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8f008082-b223-48f2-8ca3-a892da456916 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:42.643355 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8f008082-b223-48f2-8ca3-a892da456916 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:42.649381 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8f008082-b223-48f2-8ca3-a892da456916 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:42.649827 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8f008082-b223-48f2-8ca3-a892da456916 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:42.650594 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8f008082-b223-48f2-8ca3-a892da456916 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:42.651025 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8f008082-b223-48f2-8ca3-a892da456916 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:42.731300 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bb7807c4-bff4-4409-8927-b35f7764ea25 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:42.738214 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bb7807c4-bff4-4409-8927-b35f7764ea25 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:42.738655 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bb7807c4-bff4-4409-8927-b35f7764ea25 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:42.793509 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8f008082-b223-48f2-8ca3-a892da456916 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:42.801243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-bb7807c4-bff4-4409-8927-b35f7764ea25 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Going to try to stop instance {{(pid=107499) force_stop /opt/stack/nova/nova/compute/api.py:2582}} Jul 22 22:16:42.801437 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8f008082-b223-48f2-8ca3-a892da456916 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1508 microversion: 2.1 time: 0.162954 Jul 22 22:16:42.802002 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 227/461] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:42 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:42.844868 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-bb7807c4-bff4-4409-8927-b35f7764ea25 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 202 len: 0 microversion: 2.1 time: 0.117159 Jul 22 22:16:42.845462 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 235/462] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:16:42 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:16:42.856077 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1e01c1a6-f37c-46e8-a76c-c69e91aef8a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:42.857240 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1e01c1a6-f37c-46e8-a76c-c69e91aef8a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:42.866752 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1e01c1a6-f37c-46e8-a76c-c69e91aef8a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:42.867629 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1e01c1a6-f37c-46e8-a76c-c69e91aef8a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:42.869085 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1e01c1a6-f37c-46e8-a76c-c69e91aef8a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:42.869900 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1e01c1a6-f37c-46e8-a76c-c69e91aef8a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:43.014502 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1e01c1a6-f37c-46e8-a76c-c69e91aef8a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:43.022704 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1e01c1a6-f37c-46e8-a76c-c69e91aef8a2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.172462 Jul 22 22:16:43.023277 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 228/463] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:42 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:43.279563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-047280cb-1076-43e6-a13c-73efb45620a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:43.280178 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-047280cb-1076-43e6-a13c-73efb45620a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:43.287477 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-047280cb-1076-43e6-a13c-73efb45620a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:43.287924 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-047280cb-1076-43e6-a13c-73efb45620a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:43.289006 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-047280cb-1076-43e6-a13c-73efb45620a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:43.289432 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-047280cb-1076-43e6-a13c-73efb45620a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:43.432577 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-047280cb-1076-43e6-a13c-73efb45620a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:43.440986 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-047280cb-1076-43e6-a13c-73efb45620a6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.165579 Jul 22 22:16:43.441548 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 236/464] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:43 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:43.477434 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-656dba77-93a4-4ed2-b231-756d3c6164fa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:43.478057 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-656dba77-93a4-4ed2-b231-756d3c6164fa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:43.484606 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-656dba77-93a4-4ed2-b231-756d3c6164fa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:43.485064 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-656dba77-93a4-4ed2-b231-756d3c6164fa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:43.485828 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-656dba77-93a4-4ed2-b231-756d3c6164fa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:43.486264 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-656dba77-93a4-4ed2-b231-756d3c6164fa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:43.609966 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9044c4e8-773f-4f8f-b916-f788a8c080cf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:43.610880 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9044c4e8-773f-4f8f-b916-f788a8c080cf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:43.616885 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9044c4e8-773f-4f8f-b916-f788a8c080cf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:43.617342 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9044c4e8-773f-4f8f-b916-f788a8c080cf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:43.618128 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9044c4e8-773f-4f8f-b916-f788a8c080cf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:43.618560 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9044c4e8-773f-4f8f-b916-f788a8c080cf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:43.636614 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-656dba77-93a4-4ed2-b231-756d3c6164fa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:43.646368 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-656dba77-93a4-4ed2-b231-756d3c6164fa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:43.647980 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-656dba77-93a4-4ed2-b231-756d3c6164fa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:43.649175 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-656dba77-93a4-4ed2-b231-756d3c6164fa tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.175715 Jul 22 22:16:43.649730 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 229/465] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:43 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:43.794009 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9044c4e8-773f-4f8f-b916-f788a8c080cf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:43.802576 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9044c4e8-773f-4f8f-b916-f788a8c080cf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.197621 Jul 22 22:16:43.803166 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 237/466] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:43 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:43.818077 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4d946a8b-37e3-4cbc-a1df-877ccaedba24 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:43.818696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4d946a8b-37e3-4cbc-a1df-877ccaedba24 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:43.825609 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d946a8b-37e3-4cbc-a1df-877ccaedba24 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:43.826175 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d946a8b-37e3-4cbc-a1df-877ccaedba24 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:43.826945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d946a8b-37e3-4cbc-a1df-877ccaedba24 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:43.827394 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4d946a8b-37e3-4cbc-a1df-877ccaedba24 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:44.001435 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4d946a8b-37e3-4cbc-a1df-877ccaedba24 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:44.009428 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4d946a8b-37e3-4cbc-a1df-877ccaedba24 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1508 microversion: 2.1 time: 0.194928 Jul 22 22:16:44.010022 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 230/467] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:43 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:44.041454 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fbb019d6-8070-4caa-a549-f51987a52d4f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:44.042073 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fbb019d6-8070-4caa-a549-f51987a52d4f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:44.049387 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbb019d6-8070-4caa-a549-f51987a52d4f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:44.049888 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbb019d6-8070-4caa-a549-f51987a52d4f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:44.050674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbb019d6-8070-4caa-a549-f51987a52d4f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:44.051113 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fbb019d6-8070-4caa-a549-f51987a52d4f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:44.236084 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fbb019d6-8070-4caa-a549-f51987a52d4f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:44.244954 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fbb019d6-8070-4caa-a549-f51987a52d4f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.207181 Jul 22 22:16:44.245530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 238/468] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:44 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:44.457812 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ded7d145-fe92-4d59-bb03-0c87b1a4d684 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:44.458422 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ded7d145-fe92-4d59-bb03-0c87b1a4d684 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:44.464346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ded7d145-fe92-4d59-bb03-0c87b1a4d684 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:44.464793 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ded7d145-fe92-4d59-bb03-0c87b1a4d684 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:44.465542 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ded7d145-fe92-4d59-bb03-0c87b1a4d684 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:44.465967 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ded7d145-fe92-4d59-bb03-0c87b1a4d684 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:44.636296 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ded7d145-fe92-4d59-bb03-0c87b1a4d684 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:44.645400 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ded7d145-fe92-4d59-bb03-0c87b1a4d684 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.191198 Jul 22 22:16:44.646029 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 231/469] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:44 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:44.666744 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-eb1b8781-4228-4ed0-94d3-5b19fd6055c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:44.667380 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-eb1b8781-4228-4ed0-94d3-5b19fd6055c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:44.673569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb1b8781-4228-4ed0-94d3-5b19fd6055c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:44.674254 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb1b8781-4228-4ed0-94d3-5b19fd6055c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:44.675200 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb1b8781-4228-4ed0-94d3-5b19fd6055c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:44.675793 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb1b8781-4228-4ed0-94d3-5b19fd6055c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:44.820103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c2b70eb0-4aa1-4b20-a956-1f33c63d08ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:44.821061 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c2b70eb0-4aa1-4b20-a956-1f33c63d08ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:44.829810 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2b70eb0-4aa1-4b20-a956-1f33c63d08ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:44.831155 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2b70eb0-4aa1-4b20-a956-1f33c63d08ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:44.833049 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2b70eb0-4aa1-4b20-a956-1f33c63d08ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:44.833462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2b70eb0-4aa1-4b20-a956-1f33c63d08ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:44.834893 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-eb1b8781-4228-4ed0-94d3-5b19fd6055c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:44.847314 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-eb1b8781-4228-4ed0-94d3-5b19fd6055c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:44.849529 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-eb1b8781-4228-4ed0-94d3-5b19fd6055c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:44.851953 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-eb1b8781-4228-4ed0-94d3-5b19fd6055c3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.187859 Jul 22 22:16:44.853227 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 239/470] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:44 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:45.030084 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-cac1c6db-9b77-4106-9a70-121d7969d9e7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:45.030980 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-cac1c6db-9b77-4106-9a70-121d7969d9e7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:45.037070 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cac1c6db-9b77-4106-9a70-121d7969d9e7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:45.037779 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cac1c6db-9b77-4106-9a70-121d7969d9e7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:45.038720 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cac1c6db-9b77-4106-9a70-121d7969d9e7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:45.039305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cac1c6db-9b77-4106-9a70-121d7969d9e7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:45.081460 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c2b70eb0-4aa1-4b20-a956-1f33c63d08ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:45.095961 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c2b70eb0-4aa1-4b20-a956-1f33c63d08ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.279478 Jul 22 22:16:45.097474 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 232/471] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:44 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:45.264715 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f7123e53-f1d1-4b99-8f1a-7f46b6c0f4bf tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:45.265576 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f7123e53-f1d1-4b99-8f1a-7f46b6c0f4bf tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:45.271833 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f7123e53-f1d1-4b99-8f1a-7f46b6c0f4bf tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:45.272217 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f7123e53-f1d1-4b99-8f1a-7f46b6c0f4bf tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:45.273074 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f7123e53-f1d1-4b99-8f1a-7f46b6c0f4bf tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:45.273510 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f7123e53-f1d1-4b99-8f1a-7f46b6c0f4bf tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:45.287232 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-cac1c6db-9b77-4106-9a70-121d7969d9e7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:45.297367 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-cac1c6db-9b77-4106-9a70-121d7969d9e7 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1508 microversion: 2.1 time: 0.271197 Jul 22 22:16:45.298746 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 240/472] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:45 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:45.303600 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-6eceb9f5-0633-4fb2-8519-e9d283aa1a3d req-d97af9b0-5454-491c-9129-6ddffe1e7e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eab294e2-ba1d-40cd-a841-f21ef6c01964", "name": "network-vif-deleted", "tag": "b9faf1d1-d85d-4af6-8408-98838300af74"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:45.305415 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:16:45.305415 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:16:45.315067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-6eceb9f5-0633-4fb2-8519-e9d283aa1a3d req-d97af9b0-5454-491c-9129-6ddffe1e7e41 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:45.315566 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-6eceb9f5-0633-4fb2-8519-e9d283aa1a3d req-d97af9b0-5454-491c-9129-6ddffe1e7e41 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:45.331377 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-6eceb9f5-0633-4fb2-8519-e9d283aa1a3d req-d97af9b0-5454-491c-9129-6ddffe1e7e41 service nova] Creating event network-vif-deleted:b9faf1d1-d85d-4af6-8408-98838300af74 for instance eab294e2-ba1d-40cd-a841-f21ef6c01964 on hv-cinder-80186 Jul 22 22:16:45.336057 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-6eceb9f5-0633-4fb2-8519-e9d283aa1a3d req-d97af9b0-5454-491c-9129-6ddffe1e7e41 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036114 Jul 22 22:16:45.336995 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 241/473] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:16:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:16:45.428498 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f7123e53-f1d1-4b99-8f1a-7f46b6c0f4bf tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:45.437321 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f7123e53-f1d1-4b99-8f1a-7f46b6c0f4bf tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.177343 Jul 22 22:16:45.441548 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 233/474] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:45 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:45.662745 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-55e4791b-af08-43c8-b182-909f5e2e2ac9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:45.663854 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-55e4791b-af08-43c8-b182-909f5e2e2ac9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:45.671398 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55e4791b-af08-43c8-b182-909f5e2e2ac9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:45.672476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55e4791b-af08-43c8-b182-909f5e2e2ac9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:45.673330 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55e4791b-af08-43c8-b182-909f5e2e2ac9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:45.673911 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55e4791b-af08-43c8-b182-909f5e2e2ac9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:45.836501 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-55e4791b-af08-43c8-b182-909f5e2e2ac9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:45.844208 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-55e4791b-af08-43c8-b182-909f5e2e2ac9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.185651 Jul 22 22:16:45.844799 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 242/475] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:45 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:45.871028 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a79c5008-da61-443a-b91f-28270962435f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:45.871659 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a79c5008-da61-443a-b91f-28270962435f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:45.878265 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a79c5008-da61-443a-b91f-28270962435f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:45.878704 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a79c5008-da61-443a-b91f-28270962435f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:45.879827 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a79c5008-da61-443a-b91f-28270962435f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:45.880260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a79c5008-da61-443a-b91f-28270962435f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:46.022355 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a79c5008-da61-443a-b91f-28270962435f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:46.030559 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a79c5008-da61-443a-b91f-28270962435f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:46.032046 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a79c5008-da61-443a-b91f-28270962435f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:46.033268 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a79c5008-da61-443a-b91f-28270962435f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.166300 Jul 22 22:16:46.033817 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 234/476] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:45 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:46.113996 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-57d9d792-9084-40ee-b5e7-3e7234e37e32 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:46.114599 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-57d9d792-9084-40ee-b5e7-3e7234e37e32 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:46.120458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-57d9d792-9084-40ee-b5e7-3e7234e37e32 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:46.120898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-57d9d792-9084-40ee-b5e7-3e7234e37e32 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:46.121655 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-57d9d792-9084-40ee-b5e7-3e7234e37e32 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:46.122085 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-57d9d792-9084-40ee-b5e7-3e7234e37e32 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:46.260642 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-57d9d792-9084-40ee-b5e7-3e7234e37e32 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:46.268015 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-57d9d792-9084-40ee-b5e7-3e7234e37e32 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.157632 Jul 22 22:16:46.268616 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 243/477] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:46 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:46.314820 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8432bbf9-952a-43fb-98cc-498d7dd26345 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:46.315436 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8432bbf9-952a-43fb-98cc-498d7dd26345 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:46.321420 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8432bbf9-952a-43fb-98cc-498d7dd26345 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:46.321875 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8432bbf9-952a-43fb-98cc-498d7dd26345 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:46.322681 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8432bbf9-952a-43fb-98cc-498d7dd26345 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:46.323119 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8432bbf9-952a-43fb-98cc-498d7dd26345 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:46.354600 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8432bbf9-952a-43fb-98cc-498d7dd26345 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:46.355046 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8432bbf9-952a-43fb-98cc-498d7dd26345 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:46.355497 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.objects.instance [None req-8432bbf9-952a-43fb-98cc-498d7dd26345 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lazy-loading 'fault' on Instance uuid eab294e2-ba1d-40cd-a841-f21ef6c01964 {{(pid=107498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:16:46.397388 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8432bbf9-952a-43fb-98cc-498d7dd26345 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dafba37aa544fc88c36284ebab3a9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26d903c452a64781bf8cb22c894f6ddd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:46.405954 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8432bbf9-952a-43fb-98cc-498d7dd26345 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 200 len: 1308 microversion: 2.1 time: 0.094872 Jul 22 22:16:46.406517 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 235/478] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:46 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:46.454263 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-74b6d0c8-4c3d-4d59-ba4a-2e4ba5b0b6a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:46.454862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-74b6d0c8-4c3d-4d59-ba4a-2e4ba5b0b6a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:46.460672 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-74b6d0c8-4c3d-4d59-ba4a-2e4ba5b0b6a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:46.461108 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-74b6d0c8-4c3d-4d59-ba4a-2e4ba5b0b6a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:46.461865 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-74b6d0c8-4c3d-4d59-ba4a-2e4ba5b0b6a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:46.462287 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-74b6d0c8-4c3d-4d59-ba4a-2e4ba5b0b6a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:46.600575 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-74b6d0c8-4c3d-4d59-ba4a-2e4ba5b0b6a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:46.608481 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-74b6d0c8-4c3d-4d59-ba4a-2e4ba5b0b6a8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.157772 Jul 22 22:16:46.609064 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 244/479] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:46 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:46.862427 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ce02f929-f5b4-4788-b82e-9ac0128c3c8b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:46.862956 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ce02f929-f5b4-4788-b82e-9ac0128c3c8b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:46.869069 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce02f929-f5b4-4788-b82e-9ac0128c3c8b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:46.869511 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce02f929-f5b4-4788-b82e-9ac0128c3c8b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:46.870269 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce02f929-f5b4-4788-b82e-9ac0128c3c8b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:46.870694 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce02f929-f5b4-4788-b82e-9ac0128c3c8b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:47.010487 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ce02f929-f5b4-4788-b82e-9ac0128c3c8b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:47.018488 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ce02f929-f5b4-4788-b82e-9ac0128c3c8b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.159794 Jul 22 22:16:47.019053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 236/480] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:46 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:47.051231 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-354eb405-1f21-4335-bbc4-d34a96aae491 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:47.051841 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-354eb405-1f21-4335-bbc4-d34a96aae491 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:47.057733 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-354eb405-1f21-4335-bbc4-d34a96aae491 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:47.058190 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-354eb405-1f21-4335-bbc4-d34a96aae491 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:47.058956 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-354eb405-1f21-4335-bbc4-d34a96aae491 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:47.059390 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-354eb405-1f21-4335-bbc4-d34a96aae491 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:47.196934 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-354eb405-1f21-4335-bbc4-d34a96aae491 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:47.204798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-354eb405-1f21-4335-bbc4-d34a96aae491 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:47.206284 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-354eb405-1f21-4335-bbc4-d34a96aae491 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:47.207401 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-354eb405-1f21-4335-bbc4-d34a96aae491 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.159893 Jul 22 22:16:47.207949 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 245/481] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:47 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:47.284546 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-38daf961-a72c-4507-9f11-e957a3e18714 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:47.285164 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-38daf961-a72c-4507-9f11-e957a3e18714 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:47.292966 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-38daf961-a72c-4507-9f11-e957a3e18714 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:47.292966 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-38daf961-a72c-4507-9f11-e957a3e18714 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:47.292966 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-38daf961-a72c-4507-9f11-e957a3e18714 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:47.292966 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-38daf961-a72c-4507-9f11-e957a3e18714 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:47.423596 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-63964880-51e6-4c73-b2f2-145e99c76990 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:47.424177 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-63964880-51e6-4c73-b2f2-145e99c76990 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] [instance: eab294e2-ba1d-40cd-a841-f21ef6c01964] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:47.430271 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-63964880-51e6-4c73-b2f2-145e99c76990 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:47.430704 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-63964880-51e6-4c73-b2f2-145e99c76990 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:47.431476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-63964880-51e6-4c73-b2f2-145e99c76990 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:47.431902 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-63964880-51e6-4c73-b2f2-145e99c76990 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:47.447381 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-63964880-51e6-4c73-b2f2-145e99c76990 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] HTTP exception thrown: Instance eab294e2-ba1d-40cd-a841-f21ef6c01964 could not be found. Jul 22 22:16:47.447973 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-63964880-51e6-4c73-b2f2-145e99c76990 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] Returning 404 to user: Instance eab294e2-ba1d-40cd-a841-f21ef6c01964 could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:16:47.448875 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-63964880-51e6-4c73-b2f2-145e99c76990 tempest-VolumesActionsTest-824252971 tempest-VolumesActionsTest-824252971-project] 10.222.0.110 "GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964" status: 404 len: 111 microversion: 2.1 time: 0.029741 Jul 22 22:16:47.449435 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 246/482] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:47 2021] GET /compute/v2.1/servers/eab294e2-ba1d-40cd-a841-f21ef6c01964 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 22:16:47.627068 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1b340619-bc32-4476-bc55-2613f0bcc237 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:47.627894 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1b340619-bc32-4476-bc55-2613f0bcc237 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:47.634363 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1b340619-bc32-4476-bc55-2613f0bcc237 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:47.634901 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1b340619-bc32-4476-bc55-2613f0bcc237 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:47.635931 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1b340619-bc32-4476-bc55-2613f0bcc237 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:47.636478 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1b340619-bc32-4476-bc55-2613f0bcc237 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:47.672805 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-38daf961-a72c-4507-9f11-e957a3e18714 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:47.680641 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-38daf961-a72c-4507-9f11-e957a3e18714 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.399561 Jul 22 22:16:47.681360 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 237/483] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:47 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:47.786456 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1b340619-bc32-4476-bc55-2613f0bcc237 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:47.796270 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1b340619-bc32-4476-bc55-2613f0bcc237 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.174219 Jul 22 22:16:47.796900 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 247/484] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:47 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:47.921141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-e4fb0d93-bcee-45ab-b37b-4ae61680d157 req-99a20e66-65e0-46df-82f4-6a5d82514633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4e9f7e-0dbd-462c-a906-28fc0b57fa57", "name": "network-vif-plugged", "status": "completed", "tag": "92535272-b7aa-4912-9315-13139c6d3169"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:47.922981 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:16:47.922981 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:16:47.930980 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-e4fb0d93-bcee-45ab-b37b-4ae61680d157 req-99a20e66-65e0-46df-82f4-6a5d82514633 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:47.931303 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-e4fb0d93-bcee-45ab-b37b-4ae61680d157 req-99a20e66-65e0-46df-82f4-6a5d82514633 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:47.946260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-e4fb0d93-bcee-45ab-b37b-4ae61680d157 req-99a20e66-65e0-46df-82f4-6a5d82514633 service nova] Creating event network-vif-plugged:92535272-b7aa-4912-9315-13139c6d3169 for instance 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 on hv-cinder-80186 Jul 22 22:16:47.952093 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-e4fb0d93-bcee-45ab-b37b-4ae61680d157 req-99a20e66-65e0-46df-82f4-6a5d82514633 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034764 Jul 22 22:16:47.953012 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 238/485] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:16:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:16:48.035603 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9720f991-1623-4f98-8b92-3a38c654548d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:48.036226 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9720f991-1623-4f98-8b92-3a38c654548d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:48.042108 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9720f991-1623-4f98-8b92-3a38c654548d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:48.042580 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9720f991-1623-4f98-8b92-3a38c654548d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:48.043360 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9720f991-1623-4f98-8b92-3a38c654548d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:48.043794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9720f991-1623-4f98-8b92-3a38c654548d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:48.211949 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9720f991-1623-4f98-8b92-3a38c654548d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:48.227428 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fc7bc9d8-a0f1-4e09-9ada-bc15a2cab1df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:48.227970 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9720f991-1623-4f98-8b92-3a38c654548d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.195826 Jul 22 22:16:48.228121 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fc7bc9d8-a0f1-4e09-9ada-bc15a2cab1df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:48.228301 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 248/486] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:48 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:48.235813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc7bc9d8-a0f1-4e09-9ada-bc15a2cab1df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:48.236372 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc7bc9d8-a0f1-4e09-9ada-bc15a2cab1df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:48.237390 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc7bc9d8-a0f1-4e09-9ada-bc15a2cab1df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:48.238033 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc7bc9d8-a0f1-4e09-9ada-bc15a2cab1df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:48.453862 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fc7bc9d8-a0f1-4e09-9ada-bc15a2cab1df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:48.461683 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fc7bc9d8-a0f1-4e09-9ada-bc15a2cab1df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:48.463085 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fc7bc9d8-a0f1-4e09-9ada-bc15a2cab1df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:48.464205 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fc7bc9d8-a0f1-4e09-9ada-bc15a2cab1df tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.241368 Jul 22 22:16:48.464781 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 239/487] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:48 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:48.697975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-916a8e1d-00cd-42ee-96ba-31cc94c5f5d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:48.698634 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-916a8e1d-00cd-42ee-96ba-31cc94c5f5d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:48.705453 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-916a8e1d-00cd-42ee-96ba-31cc94c5f5d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:48.705898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-916a8e1d-00cd-42ee-96ba-31cc94c5f5d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:48.706666 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-916a8e1d-00cd-42ee-96ba-31cc94c5f5d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:48.707102 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-916a8e1d-00cd-42ee-96ba-31cc94c5f5d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:48.815131 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-857748a6-9be3-44fd-a1e2-944aeb228971 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:48.815887 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-857748a6-9be3-44fd-a1e2-944aeb228971 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:48.821620 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-857748a6-9be3-44fd-a1e2-944aeb228971 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:48.822062 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-857748a6-9be3-44fd-a1e2-944aeb228971 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:48.822830 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-857748a6-9be3-44fd-a1e2-944aeb228971 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:48.823259 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-857748a6-9be3-44fd-a1e2-944aeb228971 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:48.844034 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-916a8e1d-00cd-42ee-96ba-31cc94c5f5d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:48.852156 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-916a8e1d-00cd-42ee-96ba-31cc94c5f5d7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.157910 Jul 22 22:16:48.852778 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 249/488] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:48 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:48.962665 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-857748a6-9be3-44fd-a1e2-944aeb228971 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:48.970514 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-857748a6-9be3-44fd-a1e2-944aeb228971 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.159043 Jul 22 22:16:48.971091 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 240/489] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:48 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:49.245224 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-388f526d-0332-41a9-b8e1-2546a55957cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:49.245852 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-388f526d-0332-41a9-b8e1-2546a55957cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:49.251929 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-388f526d-0332-41a9-b8e1-2546a55957cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:49.252392 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-388f526d-0332-41a9-b8e1-2546a55957cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:49.253164 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-388f526d-0332-41a9-b8e1-2546a55957cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:49.253597 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-388f526d-0332-41a9-b8e1-2546a55957cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:49.396353 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-388f526d-0332-41a9-b8e1-2546a55957cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:49.403699 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-388f526d-0332-41a9-b8e1-2546a55957cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.162125 Jul 22 22:16:49.404808 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 250/490] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:49 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:49.483359 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8d81505c-18a6-4c79-a4b4-6cddb06555b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:49.483986 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8d81505c-18a6-4c79-a4b4-6cddb06555b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:49.489979 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8d81505c-18a6-4c79-a4b4-6cddb06555b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:49.490436 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8d81505c-18a6-4c79-a4b4-6cddb06555b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:49.491207 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8d81505c-18a6-4c79-a4b4-6cddb06555b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:49.491643 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8d81505c-18a6-4c79-a4b4-6cddb06555b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:49.631176 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8d81505c-18a6-4c79-a4b4-6cddb06555b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:49.639566 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8d81505c-18a6-4c79-a4b4-6cddb06555b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:49.641100 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8d81505c-18a6-4c79-a4b4-6cddb06555b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:49.642225 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8d81505c-18a6-4c79-a4b4-6cddb06555b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.163619 Jul 22 22:16:49.642775 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 241/491] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:49 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:16:49.870020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bfcf4a54-6b96-4c7d-9328-02519b47ca09 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:49.870618 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-bfcf4a54-6b96-4c7d-9328-02519b47ca09 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:49.877161 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfcf4a54-6b96-4c7d-9328-02519b47ca09 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:49.877595 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfcf4a54-6b96-4c7d-9328-02519b47ca09 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:49.878348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfcf4a54-6b96-4c7d-9328-02519b47ca09 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:49.878773 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfcf4a54-6b96-4c7d-9328-02519b47ca09 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:49.989138 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c8725112-8b14-4740-a843-7fe2dc0dd52e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:49.989749 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c8725112-8b14-4740-a843-7fe2dc0dd52e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:49.995528 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c8725112-8b14-4740-a843-7fe2dc0dd52e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:49.995976 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c8725112-8b14-4740-a843-7fe2dc0dd52e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:49.996764 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c8725112-8b14-4740-a843-7fe2dc0dd52e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:49.997194 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c8725112-8b14-4740-a843-7fe2dc0dd52e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:50.019890 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-bfcf4a54-6b96-4c7d-9328-02519b47ca09 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:50.027195 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-bfcf4a54-6b96-4c7d-9328-02519b47ca09 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.160826 Jul 22 22:16:50.027774 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 251/492] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:49 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:50.139726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c8725112-8b14-4740-a843-7fe2dc0dd52e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:50.147670 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c8725112-8b14-4740-a843-7fe2dc0dd52e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.162117 Jul 22 22:16:50.148235 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 242/493] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:49 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:50.420904 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-15ada620-5489-4d3f-bf41-5115db0acfec tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:50.421427 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-15ada620-5489-4d3f-bf41-5115db0acfec tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:50.427354 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-15ada620-5489-4d3f-bf41-5115db0acfec tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:50.427793 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-15ada620-5489-4d3f-bf41-5115db0acfec tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:50.428772 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-15ada620-5489-4d3f-bf41-5115db0acfec tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:50.429208 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-15ada620-5489-4d3f-bf41-5115db0acfec tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:50.572361 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-15ada620-5489-4d3f-bf41-5115db0acfec tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:50.580522 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-15ada620-5489-4d3f-bf41-5115db0acfec tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.163460 Jul 22 22:16:50.581087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 252/494] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:50 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:50.659442 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a3c17e30-06cb-4159-a35b-d367dd2e4d2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:50.660050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a3c17e30-06cb-4159-a35b-d367dd2e4d2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:50.667034 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3c17e30-06cb-4159-a35b-d367dd2e4d2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:50.667475 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3c17e30-06cb-4159-a35b-d367dd2e4d2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:50.668238 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3c17e30-06cb-4159-a35b-d367dd2e4d2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:50.668767 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a3c17e30-06cb-4159-a35b-d367dd2e4d2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:50.817215 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a3c17e30-06cb-4159-a35b-d367dd2e4d2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:50.825077 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a3c17e30-06cb-4159-a35b-d367dd2e4d2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:50.827338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a3c17e30-06cb-4159-a35b-d367dd2e4d2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:50.828519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a3c17e30-06cb-4159-a35b-d367dd2e4d2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.172881 Jul 22 22:16:50.829079 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 243/495] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:50 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:51.045566 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0b169265-aa06-4059-8612-0101a93ebea9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:51.046114 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0b169265-aa06-4059-8612-0101a93ebea9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:51.052594 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0b169265-aa06-4059-8612-0101a93ebea9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:51.053042 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0b169265-aa06-4059-8612-0101a93ebea9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:51.053811 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0b169265-aa06-4059-8612-0101a93ebea9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:51.054247 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0b169265-aa06-4059-8612-0101a93ebea9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:51.165439 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5f43047b-4c8b-4587-b30c-63ace08fb399 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:51.166293 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5f43047b-4c8b-4587-b30c-63ace08fb399 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:51.173674 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5f43047b-4c8b-4587-b30c-63ace08fb399 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:51.174157 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5f43047b-4c8b-4587-b30c-63ace08fb399 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:51.174943 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5f43047b-4c8b-4587-b30c-63ace08fb399 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:51.175381 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5f43047b-4c8b-4587-b30c-63ace08fb399 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:51.200246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0b169265-aa06-4059-8612-0101a93ebea9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:51.207954 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0b169265-aa06-4059-8612-0101a93ebea9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.166706 Jul 22 22:16:51.208553 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 253/496] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:51 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:51.317767 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5f43047b-4c8b-4587-b30c-63ace08fb399 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:51.325708 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5f43047b-4c8b-4587-b30c-63ace08fb399 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.163838 Jul 22 22:16:51.326582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 244/497] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:51 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:51.598200 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3f77ae0d-33de-45d4-abaa-151698237191 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:51.598724 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3f77ae0d-33de-45d4-abaa-151698237191 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:51.604611 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3f77ae0d-33de-45d4-abaa-151698237191 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:51.605053 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3f77ae0d-33de-45d4-abaa-151698237191 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:51.605811 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3f77ae0d-33de-45d4-abaa-151698237191 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:51.606251 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3f77ae0d-33de-45d4-abaa-151698237191 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:51.744389 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3f77ae0d-33de-45d4-abaa-151698237191 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:51.752523 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3f77ae0d-33de-45d4-abaa-151698237191 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.158256 Jul 22 22:16:51.753095 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 254/498] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:51 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:51.846550 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c4a62a37-81b0-4f71-a57d-ce35edb5f462 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:51.847161 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c4a62a37-81b0-4f71-a57d-ce35edb5f462 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:51.853486 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c4a62a37-81b0-4f71-a57d-ce35edb5f462 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:51.853879 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c4a62a37-81b0-4f71-a57d-ce35edb5f462 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:51.854657 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c4a62a37-81b0-4f71-a57d-ce35edb5f462 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:51.855169 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c4a62a37-81b0-4f71-a57d-ce35edb5f462 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:51.996552 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c4a62a37-81b0-4f71-a57d-ce35edb5f462 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:52.004975 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c4a62a37-81b0-4f71-a57d-ce35edb5f462 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:52.006485 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c4a62a37-81b0-4f71-a57d-ce35edb5f462 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:52.007635 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c4a62a37-81b0-4f71-a57d-ce35edb5f462 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.164764 Jul 22 22:16:52.008203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 245/499] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:51 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:52.226535 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b92968ea-8d62-4f45-9310-0e088a7585b2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:52.227312 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b92968ea-8d62-4f45-9310-0e088a7585b2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:52.235363 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b92968ea-8d62-4f45-9310-0e088a7585b2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:52.235811 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b92968ea-8d62-4f45-9310-0e088a7585b2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:52.236635 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b92968ea-8d62-4f45-9310-0e088a7585b2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:52.237065 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b92968ea-8d62-4f45-9310-0e088a7585b2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:52.343214 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cd25f6df-8848-41fa-9f05-4a655969f33f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:52.343831 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cd25f6df-8848-41fa-9f05-4a655969f33f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:52.351161 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cd25f6df-8848-41fa-9f05-4a655969f33f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:52.351606 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cd25f6df-8848-41fa-9f05-4a655969f33f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:52.353224 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cd25f6df-8848-41fa-9f05-4a655969f33f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:52.353728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cd25f6df-8848-41fa-9f05-4a655969f33f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:52.390021 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b92968ea-8d62-4f45-9310-0e088a7585b2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:52.398146 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b92968ea-8d62-4f45-9310-0e088a7585b2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.176460 Jul 22 22:16:52.399198 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 255/500] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:52 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:52.506694 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cd25f6df-8848-41fa-9f05-4a655969f33f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:52.515584 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cd25f6df-8848-41fa-9f05-4a655969f33f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.175893 Jul 22 22:16:52.515956 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 246/501] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:52 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:52.769583 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-94402c25-531a-49f7-a50d-8a8af037745a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:52.770242 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-94402c25-531a-49f7-a50d-8a8af037745a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:52.776389 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94402c25-531a-49f7-a50d-8a8af037745a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:52.776831 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94402c25-531a-49f7-a50d-8a8af037745a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:52.777590 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94402c25-531a-49f7-a50d-8a8af037745a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:52.778019 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-94402c25-531a-49f7-a50d-8a8af037745a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:52.931976 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-94402c25-531a-49f7-a50d-8a8af037745a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:52.944493 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-94402c25-531a-49f7-a50d-8a8af037745a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.179003 Jul 22 22:16:52.945086 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 256/502] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:52 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:53.027309 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-822d3cd5-adc1-4461-a39c-75c47eb1e199 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:53.027919 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-822d3cd5-adc1-4461-a39c-75c47eb1e199 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:53.035340 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-822d3cd5-adc1-4461-a39c-75c47eb1e199 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:53.035793 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-822d3cd5-adc1-4461-a39c-75c47eb1e199 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:53.036610 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-822d3cd5-adc1-4461-a39c-75c47eb1e199 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:53.037047 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-822d3cd5-adc1-4461-a39c-75c47eb1e199 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:53.197981 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-822d3cd5-adc1-4461-a39c-75c47eb1e199 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:53.207303 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-822d3cd5-adc1-4461-a39c-75c47eb1e199 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:53.209014 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-822d3cd5-adc1-4461-a39c-75c47eb1e199 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:53.210233 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-822d3cd5-adc1-4461-a39c-75c47eb1e199 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.187038 Jul 22 22:16:53.210806 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 247/503] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:53 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:53.423821 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-24edd845-9b56-495b-8a50-3a62f1c374f3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:53.424488 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-24edd845-9b56-495b-8a50-3a62f1c374f3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:53.430665 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24edd845-9b56-495b-8a50-3a62f1c374f3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:53.431115 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24edd845-9b56-495b-8a50-3a62f1c374f3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:53.431908 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24edd845-9b56-495b-8a50-3a62f1c374f3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:53.432386 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24edd845-9b56-495b-8a50-3a62f1c374f3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:53.533554 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7379fe0f-daf8-4d54-bb61-c0e1b4a0be27 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:53.534340 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7379fe0f-daf8-4d54-bb61-c0e1b4a0be27 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:53.540266 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7379fe0f-daf8-4d54-bb61-c0e1b4a0be27 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:53.540739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7379fe0f-daf8-4d54-bb61-c0e1b4a0be27 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:53.541515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7379fe0f-daf8-4d54-bb61-c0e1b4a0be27 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:53.541949 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7379fe0f-daf8-4d54-bb61-c0e1b4a0be27 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:53.579216 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-24edd845-9b56-495b-8a50-3a62f1c374f3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:53.587113 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-24edd845-9b56-495b-8a50-3a62f1c374f3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.168146 Jul 22 22:16:53.587694 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 257/504] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:53 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:53.694092 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7379fe0f-daf8-4d54-bb61-c0e1b4a0be27 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:53.702743 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7379fe0f-daf8-4d54-bb61-c0e1b4a0be27 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.173103 Jul 22 22:16:53.703311 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 248/505] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:53 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:53.961570 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-24ed40ae-1516-4923-a8fd-0c4fcdc67c7a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:53.962140 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-24ed40ae-1516-4923-a8fd-0c4fcdc67c7a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:53.969114 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24ed40ae-1516-4923-a8fd-0c4fcdc67c7a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:53.969695 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24ed40ae-1516-4923-a8fd-0c4fcdc67c7a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:53.970737 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24ed40ae-1516-4923-a8fd-0c4fcdc67c7a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:53.971344 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24ed40ae-1516-4923-a8fd-0c4fcdc67c7a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:54.133734 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-24ed40ae-1516-4923-a8fd-0c4fcdc67c7a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:54.142147 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-24ed40ae-1516-4923-a8fd-0c4fcdc67c7a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1322 microversion: 2.1 time: 0.184219 Jul 22 22:16:54.142788 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 258/506] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:53 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:54.242194 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-337f39a4-cc0a-48e1-8f75-6d401462c070 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:54.242728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-337f39a4-cc0a-48e1-8f75-6d401462c070 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:54.249483 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-337f39a4-cc0a-48e1-8f75-6d401462c070 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:54.249926 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-337f39a4-cc0a-48e1-8f75-6d401462c070 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:54.250697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-337f39a4-cc0a-48e1-8f75-6d401462c070 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:54.251131 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-337f39a4-cc0a-48e1-8f75-6d401462c070 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:54.406504 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-337f39a4-cc0a-48e1-8f75-6d401462c070 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:54.414932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-337f39a4-cc0a-48e1-8f75-6d401462c070 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:54.416446 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-337f39a4-cc0a-48e1-8f75-6d401462c070 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:54.417607 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-337f39a4-cc0a-48e1-8f75-6d401462c070 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.179264 Jul 22 22:16:54.418155 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 249/507] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:54 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:54.606327 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4d694471-a574-4e3e-b98f-39dbe9c1404f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:54.606969 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4d694471-a574-4e3e-b98f-39dbe9c1404f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:54.612838 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d694471-a574-4e3e-b98f-39dbe9c1404f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:54.613291 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d694471-a574-4e3e-b98f-39dbe9c1404f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:54.614061 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d694471-a574-4e3e-b98f-39dbe9c1404f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:54.614494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d694471-a574-4e3e-b98f-39dbe9c1404f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:54.720737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c102a93c-f3f5-40ca-9ca9-4b6b1a9349c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:54.721357 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c102a93c-f3f5-40ca-9ca9-4b6b1a9349c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:54.727701 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c102a93c-f3f5-40ca-9ca9-4b6b1a9349c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:54.728205 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c102a93c-f3f5-40ca-9ca9-4b6b1a9349c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:54.729018 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c102a93c-f3f5-40ca-9ca9-4b6b1a9349c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:54.729446 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c102a93c-f3f5-40ca-9ca9-4b6b1a9349c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:54.788732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4d694471-a574-4e3e-b98f-39dbe9c1404f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:54.797343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4d694471-a574-4e3e-b98f-39dbe9c1404f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.194919 Jul 22 22:16:54.797929 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 259/508] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:54 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:54.873703 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c102a93c-f3f5-40ca-9ca9-4b6b1a9349c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:54.881837 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c102a93c-f3f5-40ca-9ca9-4b6b1a9349c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.165768 Jul 22 22:16:54.882409 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 250/509] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:54 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:55.163071 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4b3f57f0-08b4-48ff-b407-7e90cc67fdc5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:55.163859 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4b3f57f0-08b4-48ff-b407-7e90cc67fdc5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:55.171419 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4b3f57f0-08b4-48ff-b407-7e90cc67fdc5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:55.171863 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4b3f57f0-08b4-48ff-b407-7e90cc67fdc5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:55.172691 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4b3f57f0-08b4-48ff-b407-7e90cc67fdc5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:55.173124 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4b3f57f0-08b4-48ff-b407-7e90cc67fdc5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:55.335642 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4b3f57f0-08b4-48ff-b407-7e90cc67fdc5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:55.350689 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4b3f57f0-08b4-48ff-b407-7e90cc67fdc5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1511 microversion: 2.1 time: 0.192735 Jul 22 22:16:55.351271 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 260/510] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:55 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:55.438818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c198673d-73ca-4624-892c-2dfb8eecd9f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:55.440313 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c198673d-73ca-4624-892c-2dfb8eecd9f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:55.446474 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c198673d-73ca-4624-892c-2dfb8eecd9f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:55.447114 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c198673d-73ca-4624-892c-2dfb8eecd9f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:55.447901 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c198673d-73ca-4624-892c-2dfb8eecd9f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:55.448366 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c198673d-73ca-4624-892c-2dfb8eecd9f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:55.614702 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c198673d-73ca-4624-892c-2dfb8eecd9f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:55.626497 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c198673d-73ca-4624-892c-2dfb8eecd9f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:55.628004 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c198673d-73ca-4624-892c-2dfb8eecd9f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:55.629877 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c198673d-73ca-4624-892c-2dfb8eecd9f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.196622 Jul 22 22:16:55.630875 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 251/511] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:55 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:55.815301 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2181f3b3-298d-41f4-b4d1-af047842135f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:55.816474 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2181f3b3-298d-41f4-b4d1-af047842135f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:55.829201 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2181f3b3-298d-41f4-b4d1-af047842135f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:55.830284 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2181f3b3-298d-41f4-b4d1-af047842135f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:55.831794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2181f3b3-298d-41f4-b4d1-af047842135f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:55.832831 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2181f3b3-298d-41f4-b4d1-af047842135f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:55.898912 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d08e9f60-e6a1-409e-903c-0fabf2f2e8ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:55.899527 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d08e9f60-e6a1-409e-903c-0fabf2f2e8ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:55.906483 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d08e9f60-e6a1-409e-903c-0fabf2f2e8ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:55.907108 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d08e9f60-e6a1-409e-903c-0fabf2f2e8ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:55.908138 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d08e9f60-e6a1-409e-903c-0fabf2f2e8ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:55.908758 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d08e9f60-e6a1-409e-903c-0fabf2f2e8ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:56.007612 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2181f3b3-298d-41f4-b4d1-af047842135f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:56.016207 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2181f3b3-298d-41f4-b4d1-af047842135f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.205679 Jul 22 22:16:56.016809 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 261/512] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:55 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:56.021737 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1837714353", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1673230260", "security_groups": [{"name": "tempest-secgroup-smoke-1993943540"}], "block_device_mapping_v2": [{"uuid": "0071f103-1072-41b2-8e6f-e8237c60f1a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e529f4f-4b03-4451-832a-e468345894dd"}]}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:56.061857 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d08e9f60-e6a1-409e-903c-0fabf2f2e8ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:56.069583 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d08e9f60-e6a1-409e-903c-0fabf2f2e8ed tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.174328 Jul 22 22:16:56.070140 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 252/513] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:55 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:56.125414 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.network.neutron [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] validate_networks() for [('7e529f4f-4b03-4451-832a-e468345894dd', None, None, None)] {{(pid=107499) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:16:56.561093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Flavor limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:16:56.562325 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Image limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:16:56.563045 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Flavor pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:16:56.563703 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Image pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:16:56.564220 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:16:56.575968 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:56.576900 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:56.578009 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:56.578728 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:56.598910 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Getting quotas for project 853ea27311ea40e185ea767354f4dec1. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:16:56.602858 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Getting quotas for user 4af694abdd744df1beb130211b80774a and project 853ea27311ea40e185ea767354f4dec1. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:16:56.647465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1ce9f82c-1a21-459b-bd6d-ad7ed0c4bf2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:56.648515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1ce9f82c-1a21-459b-bd6d-ad7ed0c4bf2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:56.660027 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1ce9f82c-1a21-459b-bd6d-ad7ed0c4bf2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:56.660799 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1ce9f82c-1a21-459b-bd6d-ad7ed0c4bf2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:56.661856 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1ce9f82c-1a21-459b-bd6d-ad7ed0c4bf2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:56.662361 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1ce9f82c-1a21-459b-bd6d-ad7ed0c4bf2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:56.683637 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Going to run 1 instances... {{(pid=107499) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:16:56.692405 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0071f103-1072-41b2-8e6f-e8237c60f1a8',volume_size=None,volume_type=None)] {{(pid=107499) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:16:56.855958 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1ce9f82c-1a21-459b-bd6d-ad7ed0c4bf2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:56.868382 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1ce9f82c-1a21-459b-bd6d-ad7ed0c4bf2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:56.874857 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1ce9f82c-1a21-459b-bd6d-ad7ed0c4bf2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:56.876307 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1ce9f82c-1a21-459b-bd6d-ad7ed0c4bf2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.232741 Jul 22 22:16:56.879630 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 253/514] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:56 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:16:56.885885 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-590f6146-b11b-4bdb-9ac3-f29bb3410cbf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.867467 Jul 22 22:16:56.886676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 262/515] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:16:56 2021] POST /compute/v2.1/servers => generated 408 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:16:56.899431 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-894d47ab-a586-46bd-a4ce-d0ef81456ba2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:56.899952 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-434e40b4-9b6f-40be-a6cf-0fb00ee68163 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "064decea-e3e6-4a21-a749-9744e117c749"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:16:56.900532 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-894d47ab-a586-46bd-a4ce-d0ef81456ba2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:56.901347 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-434e40b4-9b6f-40be-a6cf-0fb00ee68163 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:56.922417 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-434e40b4-9b6f-40be-a6cf-0fb00ee68163 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:56.923752 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-434e40b4-9b6f-40be-a6cf-0fb00ee68163 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:56.924936 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-434e40b4-9b6f-40be-a6cf-0fb00ee68163 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:56.925597 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-434e40b4-9b6f-40be-a6cf-0fb00ee68163 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:56.982277 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-894d47ab-a586-46bd-a4ce-d0ef81456ba2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:56.990618 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-894d47ab-a586-46bd-a4ce-d0ef81456ba2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1098 microversion: 2.1 time: 0.094763 Jul 22 22:16:57.001037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 263/516] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:56 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1098 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:57.035653 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7e619b83-8011-4b09-b0df-087a13a304df tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:57.036292 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7e619b83-8011-4b09-b0df-087a13a304df tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:57.043636 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e619b83-8011-4b09-b0df-087a13a304df tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:57.044102 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e619b83-8011-4b09-b0df-087a13a304df tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:57.045149 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e619b83-8011-4b09-b0df-087a13a304df tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:57.045679 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e619b83-8011-4b09-b0df-087a13a304df tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:57.298182 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7e619b83-8011-4b09-b0df-087a13a304df tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:57.315276 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7e619b83-8011-4b09-b0df-087a13a304df tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.281913 Jul 22 22:16:57.317253 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 264/517] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:57 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:16:57.327777 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1bd29728-7280-4e44-b2b1-ee11737f5f73 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:57.328385 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1bd29728-7280-4e44-b2b1-ee11737f5f73 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:57.335405 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1bd29728-7280-4e44-b2b1-ee11737f5f73 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:57.336089 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1bd29728-7280-4e44-b2b1-ee11737f5f73 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:57.337091 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1bd29728-7280-4e44-b2b1-ee11737f5f73 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:57.337714 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1bd29728-7280-4e44-b2b1-ee11737f5f73 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:57.365687 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-434e40b4-9b6f-40be-a6cf-0fb00ee68163 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "POST /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471721 Jul 22 22:16:57.367036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 254/518] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:16:56 2021] POST /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:16:57.606041 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1bd29728-7280-4e44-b2b1-ee11737f5f73 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:57.617222 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1bd29728-7280-4e44-b2b1-ee11737f5f73 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.297068 Jul 22 22:16:57.618409 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 265/519] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:57 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:57.898198 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b0e0c6e6-a76d-4422-b5e9-90a2ec140ada tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:57.898898 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b0e0c6e6-a76d-4422-b5e9-90a2ec140ada tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:57.906730 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0e0c6e6-a76d-4422-b5e9-90a2ec140ada tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:57.907192 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0e0c6e6-a76d-4422-b5e9-90a2ec140ada tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:57.907975 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0e0c6e6-a76d-4422-b5e9-90a2ec140ada tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:57.908675 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0e0c6e6-a76d-4422-b5e9-90a2ec140ada tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:58.009413 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-66382a4e-3af4-4d0d-be3b-357ef0ed935c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:58.011158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-66382a4e-3af4-4d0d-be3b-357ef0ed935c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:58.018061 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-66382a4e-3af4-4d0d-be3b-357ef0ed935c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:58.018616 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-66382a4e-3af4-4d0d-be3b-357ef0ed935c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:58.019671 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-66382a4e-3af4-4d0d-be3b-357ef0ed935c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:58.020210 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-66382a4e-3af4-4d0d-be3b-357ef0ed935c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:58.094430 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b0e0c6e6-a76d-4422-b5e9-90a2ec140ada tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:58.103245 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b0e0c6e6-a76d-4422-b5e9-90a2ec140ada tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:58.104794 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b0e0c6e6-a76d-4422-b5e9-90a2ec140ada tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:58.105951 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b0e0c6e6-a76d-4422-b5e9-90a2ec140ada tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.211850 Jul 22 22:16:58.106508 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 255/520] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:57 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:58.112683 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-66382a4e-3af4-4d0d-be3b-357ef0ed935c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:58.122720 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-66382a4e-3af4-4d0d-be3b-357ef0ed935c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1196 microversion: 2.1 time: 0.116965 Jul 22 22:16:58.123917 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 266/521] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:58 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1196 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:58.334521 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e79387e0-7c71-4794-902e-91097588b652 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:58.335132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e79387e0-7c71-4794-902e-91097588b652 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:58.341480 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e79387e0-7c71-4794-902e-91097588b652 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:58.341927 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e79387e0-7c71-4794-902e-91097588b652 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:58.342917 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e79387e0-7c71-4794-902e-91097588b652 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:58.343136 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e79387e0-7c71-4794-902e-91097588b652 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:58.540969 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e79387e0-7c71-4794-902e-91097588b652 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:58.563133 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e79387e0-7c71-4794-902e-91097588b652 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.229472 Jul 22 22:16:58.564621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 256/522] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:58 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:58.638939 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-49aa08cf-f931-4b6b-9eed-91c50dd5a589 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:58.639851 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-49aa08cf-f931-4b6b-9eed-91c50dd5a589 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:58.646660 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49aa08cf-f931-4b6b-9eed-91c50dd5a589 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:58.647532 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49aa08cf-f931-4b6b-9eed-91c50dd5a589 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:58.647983 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49aa08cf-f931-4b6b-9eed-91c50dd5a589 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:58.648449 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-49aa08cf-f931-4b6b-9eed-91c50dd5a589 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:58.856973 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-49aa08cf-f931-4b6b-9eed-91c50dd5a589 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:58.870170 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-49aa08cf-f931-4b6b-9eed-91c50dd5a589 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.234496 Jul 22 22:16:58.877322 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 267/523] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:58 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:59.129376 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2a5dc9c4-f4c4-4993-8dbb-f53bc51fd3d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:59.131395 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2a5dc9c4-f4c4-4993-8dbb-f53bc51fd3d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:59.144086 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-914ac409-2223-4ddc-9320-797eb6fa1c30 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:59.144814 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-914ac409-2223-4ddc-9320-797eb6fa1c30 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:59.154252 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2a5dc9c4-f4c4-4993-8dbb-f53bc51fd3d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:59.154840 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2a5dc9c4-f4c4-4993-8dbb-f53bc51fd3d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:59.160347 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-914ac409-2223-4ddc-9320-797eb6fa1c30 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:59.160947 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-914ac409-2223-4ddc-9320-797eb6fa1c30 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:59.161844 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-914ac409-2223-4ddc-9320-797eb6fa1c30 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:59.162363 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-914ac409-2223-4ddc-9320-797eb6fa1c30 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:59.165838 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2a5dc9c4-f4c4-4993-8dbb-f53bc51fd3d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:59.166529 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2a5dc9c4-f4c4-4993-8dbb-f53bc51fd3d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:59.277569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-914ac409-2223-4ddc-9320-797eb6fa1c30 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:59.293086 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-914ac409-2223-4ddc-9320-797eb6fa1c30 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1214 microversion: 2.1 time: 0.152998 Jul 22 22:16:59.293839 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 268/524] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:59 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:59.532915 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2a5dc9c4-f4c4-4993-8dbb-f53bc51fd3d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:59.543090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2a5dc9c4-f4c4-4993-8dbb-f53bc51fd3d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:59.546403 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2a5dc9c4-f4c4-4993-8dbb-f53bc51fd3d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:59.547989 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2a5dc9c4-f4c4-4993-8dbb-f53bc51fd3d6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.424765 Jul 22 22:16:59.549103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 257/525] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:16:59 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:16:59.582140 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-01a88d27-2827-4425-9283-a268b8507fbf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:59.582898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-01a88d27-2827-4425-9283-a268b8507fbf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:59.603336 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-01a88d27-2827-4425-9283-a268b8507fbf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:59.603818 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-01a88d27-2827-4425-9283-a268b8507fbf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:59.609068 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-01a88d27-2827-4425-9283-a268b8507fbf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:59.609527 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-01a88d27-2827-4425-9283-a268b8507fbf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:59.876482 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-01a88d27-2827-4425-9283-a268b8507fbf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:16:59.886297 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-01a88d27-2827-4425-9283-a268b8507fbf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.308017 Jul 22 22:16:59.902616 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-49bff176-60f7-4c75-b377-2432386f988b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:16:59.904522 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-49bff176-60f7-4c75-b377-2432386f988b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:16:59.911615 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 269/526] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:59 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:16:59.914057 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49bff176-60f7-4c75-b377-2432386f988b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:59.914711 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49bff176-60f7-4c75-b377-2432386f988b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:16:59.915744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49bff176-60f7-4c75-b377-2432386f988b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:16:59.916380 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49bff176-60f7-4c75-b377-2432386f988b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:00.330704 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-16912a73-ba82-4824-a0e9-dbca4ef58f0c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:00.331681 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-16912a73-ba82-4824-a0e9-dbca4ef58f0c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:00.340132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-49bff176-60f7-4c75-b377-2432386f988b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:00.344530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-16912a73-ba82-4824-a0e9-dbca4ef58f0c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:00.347992 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-16912a73-ba82-4824-a0e9-dbca4ef58f0c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:00.350215 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-16912a73-ba82-4824-a0e9-dbca4ef58f0c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:00.350881 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-16912a73-ba82-4824-a0e9-dbca4ef58f0c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:00.355078 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-49bff176-60f7-4c75-b377-2432386f988b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.456877 Jul 22 22:17:00.355713 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 258/527] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:16:59 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:00.584407 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1518956d-a159-4e43-8b5b-69bd70707405 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:00.590210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1518956d-a159-4e43-8b5b-69bd70707405 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:00.614755 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1518956d-a159-4e43-8b5b-69bd70707405 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:00.615966 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1518956d-a159-4e43-8b5b-69bd70707405 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:00.618805 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1518956d-a159-4e43-8b5b-69bd70707405 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:00.619737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1518956d-a159-4e43-8b5b-69bd70707405 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:00.620037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-16912a73-ba82-4824-a0e9-dbca4ef58f0c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:00.633539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-16912a73-ba82-4824-a0e9-dbca4ef58f0c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1282 microversion: 2.1 time: 0.308167 Jul 22 22:17:00.634513 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 270/528] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:00 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1282 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:00.903284 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1a90b18c-16d2-410d-bd14-f5444308420e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:00.905111 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1a90b18c-16d2-410d-bd14-f5444308420e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:00.911701 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1a90b18c-16d2-410d-bd14-f5444308420e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:00.912329 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1a90b18c-16d2-410d-bd14-f5444308420e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:00.913401 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1a90b18c-16d2-410d-bd14-f5444308420e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:00.913940 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1a90b18c-16d2-410d-bd14-f5444308420e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:01.132376 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1a90b18c-16d2-410d-bd14-f5444308420e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:01.144037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1a90b18c-16d2-410d-bd14-f5444308420e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.244322 Jul 22 22:17:01.152042 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1518956d-a159-4e43-8b5b-69bd70707405 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:01.157423 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 271/529] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:00 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:01.173958 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1518956d-a159-4e43-8b5b-69bd70707405 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:01.175914 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1518956d-a159-4e43-8b5b-69bd70707405 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:01.179259 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1518956d-a159-4e43-8b5b-69bd70707405 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.613075 Jul 22 22:17:01.180220 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 259/530] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:00 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:01.380161 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3bb1c2c4-badd-4d9e-be0d-62154d108c6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:01.381302 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3bb1c2c4-badd-4d9e-be0d-62154d108c6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:01.392462 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3bb1c2c4-badd-4d9e-be0d-62154d108c6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:01.393317 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3bb1c2c4-badd-4d9e-be0d-62154d108c6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:01.394537 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3bb1c2c4-badd-4d9e-be0d-62154d108c6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:01.395230 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3bb1c2c4-badd-4d9e-be0d-62154d108c6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:01.657664 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-690ce89a-8b2f-494d-92b0-6dcaaec5fcb6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:01.659107 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-690ce89a-8b2f-494d-92b0-6dcaaec5fcb6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:01.678234 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-690ce89a-8b2f-494d-92b0-6dcaaec5fcb6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:01.680386 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-690ce89a-8b2f-494d-92b0-6dcaaec5fcb6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:01.681942 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-690ce89a-8b2f-494d-92b0-6dcaaec5fcb6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:01.682482 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-690ce89a-8b2f-494d-92b0-6dcaaec5fcb6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:01.688119 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3bb1c2c4-badd-4d9e-be0d-62154d108c6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:01.713455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3bb1c2c4-badd-4d9e-be0d-62154d108c6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.339230 Jul 22 22:17:01.749550 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 272/531] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:01 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:01.772208 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-9dd101c3-2fe0-4b2a-9aa9-a3466b222d05 req-d7856d57-7946-4300-bf34-cb809ca16580 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230e9e16-9304-4b70-bf95-34811d9fd221", "tag": "a11e48e2-13ab-49d9-9f7b-acdce4f4cd4f"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:01.788569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:17:01.788569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:17:01.807267 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-9dd101c3-2fe0-4b2a-9aa9-a3466b222d05 req-d7856d57-7946-4300-bf34-cb809ca16580 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:01.807919 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-9dd101c3-2fe0-4b2a-9aa9-a3466b222d05 req-d7856d57-7946-4300-bf34-cb809ca16580 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:01.841779 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-9dd101c3-2fe0-4b2a-9aa9-a3466b222d05 req-d7856d57-7946-4300-bf34-cb809ca16580 service nova] Creating event network-changed:a11e48e2-13ab-49d9-9f7b-acdce4f4cd4f for instance 230e9e16-9304-4b70-bf95-34811d9fd221 on hv-cinder-80186 Jul 22 22:17:01.851541 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-9dd101c3-2fe0-4b2a-9aa9-a3466b222d05 req-d7856d57-7946-4300-bf34-cb809ca16580 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089649 Jul 22 22:17:01.853139 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 273/532] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:17:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:17:02.003026 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-690ce89a-8b2f-494d-92b0-6dcaaec5fcb6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:02.011698 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-690ce89a-8b2f-494d-92b0-6dcaaec5fcb6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1282 microversion: 2.1 time: 0.360129 Jul 22 22:17:02.015860 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 260/533] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:01 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1282 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:02.167141 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e49be4bc-3d4b-43e7-b95a-cd02e7891562 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:02.167849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e49be4bc-3d4b-43e7-b95a-cd02e7891562 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:02.177150 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e49be4bc-3d4b-43e7-b95a-cd02e7891562 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:02.177678 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e49be4bc-3d4b-43e7-b95a-cd02e7891562 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:02.178574 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e49be4bc-3d4b-43e7-b95a-cd02e7891562 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:02.179118 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e49be4bc-3d4b-43e7-b95a-cd02e7891562 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:02.200823 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4266be56-ecbb-48d2-af7a-40ce8d79b2a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:02.201938 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4266be56-ecbb-48d2-af7a-40ce8d79b2a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:02.212593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4266be56-ecbb-48d2-af7a-40ce8d79b2a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:02.213353 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4266be56-ecbb-48d2-af7a-40ce8d79b2a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:02.214350 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4266be56-ecbb-48d2-af7a-40ce8d79b2a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:02.218686 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4266be56-ecbb-48d2-af7a-40ce8d79b2a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:02.392958 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e49be4bc-3d4b-43e7-b95a-cd02e7891562 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:02.401038 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e49be4bc-3d4b-43e7-b95a-cd02e7891562 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.240825 Jul 22 22:17:02.402330 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 274/534] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:02 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:02.517649 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4266be56-ecbb-48d2-af7a-40ce8d79b2a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:02.526754 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4266be56-ecbb-48d2-af7a-40ce8d79b2a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:02.528758 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4266be56-ecbb-48d2-af7a-40ce8d79b2a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:02.530403 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4266be56-ecbb-48d2-af7a-40ce8d79b2a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.333290 Jul 22 22:17:02.531615 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 261/535] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:02 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:02.772982 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-02108e6b-4bb7-4cbb-9bb8-240078bc9453 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:02.774487 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-02108e6b-4bb7-4cbb-9bb8-240078bc9453 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:02.786219 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-02108e6b-4bb7-4cbb-9bb8-240078bc9453 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:02.787559 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-02108e6b-4bb7-4cbb-9bb8-240078bc9453 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:02.789246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-02108e6b-4bb7-4cbb-9bb8-240078bc9453 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:02.790691 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-02108e6b-4bb7-4cbb-9bb8-240078bc9453 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:03.018361 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-02108e6b-4bb7-4cbb-9bb8-240078bc9453 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:03.034697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d4ebdfba-5d4b-473d-ace9-49a2ad7c151b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:03.035597 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-02108e6b-4bb7-4cbb-9bb8-240078bc9453 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.270190 Jul 22 22:17:03.036999 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d4ebdfba-5d4b-473d-ace9-49a2ad7c151b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:03.043757 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4ebdfba-5d4b-473d-ace9-49a2ad7c151b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:03.044864 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4ebdfba-5d4b-473d-ace9-49a2ad7c151b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:03.046297 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 275/536] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:02 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:03.047129 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4ebdfba-5d4b-473d-ace9-49a2ad7c151b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:03.047655 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4ebdfba-5d4b-473d-ace9-49a2ad7c151b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:03.274352 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d4ebdfba-5d4b-473d-ace9-49a2ad7c151b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:03.291932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d4ebdfba-5d4b-473d-ace9-49a2ad7c151b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1282 microversion: 2.1 time: 0.260611 Jul 22 22:17:03.293361 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 262/537] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:03 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1282 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:03.421398 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-be77b739-a421-4c59-a8bb-30fd920c2725 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:03.422809 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-be77b739-a421-4c59-a8bb-30fd920c2725 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:03.430486 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-be77b739-a421-4c59-a8bb-30fd920c2725 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:03.431029 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-be77b739-a421-4c59-a8bb-30fd920c2725 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:03.431808 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-be77b739-a421-4c59-a8bb-30fd920c2725 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:03.432232 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-be77b739-a421-4c59-a8bb-30fd920c2725 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:03.551807 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-95a8f1e6-3b54-4bda-956b-01d630e8a5e0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:03.553010 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-95a8f1e6-3b54-4bda-956b-01d630e8a5e0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:03.560808 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95a8f1e6-3b54-4bda-956b-01d630e8a5e0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:03.561793 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95a8f1e6-3b54-4bda-956b-01d630e8a5e0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:03.562818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95a8f1e6-3b54-4bda-956b-01d630e8a5e0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:03.563668 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95a8f1e6-3b54-4bda-956b-01d630e8a5e0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:03.608556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-be77b739-a421-4c59-a8bb-30fd920c2725 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:03.616579 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-be77b739-a421-4c59-a8bb-30fd920c2725 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.200339 Jul 22 22:17:03.617158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 276/538] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:03 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:03.788717 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-95a8f1e6-3b54-4bda-956b-01d630e8a5e0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:03.799269 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-95a8f1e6-3b54-4bda-956b-01d630e8a5e0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:03.801912 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-95a8f1e6-3b54-4bda-956b-01d630e8a5e0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:03.804737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-95a8f1e6-3b54-4bda-956b-01d630e8a5e0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.258464 Jul 22 22:17:03.805625 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 263/539] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:03 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:04.053142 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0972c7d2-2421-4d79-b264-f23cb59c249a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:04.053773 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0972c7d2-2421-4d79-b264-f23cb59c249a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:04.061294 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0972c7d2-2421-4d79-b264-f23cb59c249a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:04.061749 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0972c7d2-2421-4d79-b264-f23cb59c249a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:04.062543 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0972c7d2-2421-4d79-b264-f23cb59c249a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:04.062982 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0972c7d2-2421-4d79-b264-f23cb59c249a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:04.210655 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0972c7d2-2421-4d79-b264-f23cb59c249a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:04.220245 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0972c7d2-2421-4d79-b264-f23cb59c249a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.170696 Jul 22 22:17:04.220835 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 277/540] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:04 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:04.313245 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b72cfb29-b261-4085-bbb2-d869cef3150d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:04.314230 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b72cfb29-b261-4085-bbb2-d869cef3150d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:04.320891 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b72cfb29-b261-4085-bbb2-d869cef3150d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:04.321671 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b72cfb29-b261-4085-bbb2-d869cef3150d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:04.322468 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b72cfb29-b261-4085-bbb2-d869cef3150d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:04.322904 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b72cfb29-b261-4085-bbb2-d869cef3150d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:04.477257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b72cfb29-b261-4085-bbb2-d869cef3150d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:04.485790 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b72cfb29-b261-4085-bbb2-d869cef3150d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1282 microversion: 2.1 time: 0.177284 Jul 22 22:17:04.486369 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 264/541] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:04 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1282 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:04.634529 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4a15c43c-6322-4ace-9ed2-b85edafe1555 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:04.635251 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4a15c43c-6322-4ace-9ed2-b85edafe1555 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:04.642462 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4a15c43c-6322-4ace-9ed2-b85edafe1555 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:04.642994 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4a15c43c-6322-4ace-9ed2-b85edafe1555 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:04.643851 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4a15c43c-6322-4ace-9ed2-b85edafe1555 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:04.644415 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4a15c43c-6322-4ace-9ed2-b85edafe1555 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:04.824074 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9bf31e3f-721f-4048-a842-5ca4f4359cc9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:04.824633 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4a15c43c-6322-4ace-9ed2-b85edafe1555 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:04.824845 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9bf31e3f-721f-4048-a842-5ca4f4359cc9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:04.831292 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9bf31e3f-721f-4048-a842-5ca4f4359cc9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:04.831739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9bf31e3f-721f-4048-a842-5ca4f4359cc9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:04.832537 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9bf31e3f-721f-4048-a842-5ca4f4359cc9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:04.833122 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9bf31e3f-721f-4048-a842-5ca4f4359cc9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:04.834225 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4a15c43c-6322-4ace-9ed2-b85edafe1555 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.203540 Jul 22 22:17:04.835985 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 278/542] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:04 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:04.982603 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9bf31e3f-721f-4048-a842-5ca4f4359cc9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:04.990740 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9bf31e3f-721f-4048-a842-5ca4f4359cc9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:04.992219 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9bf31e3f-721f-4048-a842-5ca4f4359cc9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:04.993407 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9bf31e3f-721f-4048-a842-5ca4f4359cc9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1748 microversion: 2.20 time: 0.173831 Jul 22 22:17:04.993957 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 265/543] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:04 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1748 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:05.238429 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7ca0edc6-103f-4155-83ca-00537cbbff40 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:05.239179 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7ca0edc6-103f-4155-83ca-00537cbbff40 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:05.245105 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7ca0edc6-103f-4155-83ca-00537cbbff40 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:05.245541 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7ca0edc6-103f-4155-83ca-00537cbbff40 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:05.246355 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7ca0edc6-103f-4155-83ca-00537cbbff40 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:05.246718 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7ca0edc6-103f-4155-83ca-00537cbbff40 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:05.399952 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7ca0edc6-103f-4155-83ca-00537cbbff40 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:05.410645 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7ca0edc6-103f-4155-83ca-00537cbbff40 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.175563 Jul 22 22:17:05.411665 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 279/544] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:05 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:05.503226 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7a5edaf5-0424-470a-97b1-9f4b16eb3ad9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:05.503827 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7a5edaf5-0424-470a-97b1-9f4b16eb3ad9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:05.509732 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a5edaf5-0424-470a-97b1-9f4b16eb3ad9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:05.510170 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a5edaf5-0424-470a-97b1-9f4b16eb3ad9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:05.510936 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a5edaf5-0424-470a-97b1-9f4b16eb3ad9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:05.511364 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a5edaf5-0424-470a-97b1-9f4b16eb3ad9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:05.655885 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7a5edaf5-0424-470a-97b1-9f4b16eb3ad9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:05.663618 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7a5edaf5-0424-470a-97b1-9f4b16eb3ad9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1282 microversion: 2.1 time: 0.163970 Jul 22 22:17:05.664223 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 266/545] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:05 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1282 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:05.851164 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b4bfb770-6a57-41f8-9fd2-3d7a219dd75a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:05.851771 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b4bfb770-6a57-41f8-9fd2-3d7a219dd75a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:05.866934 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b4bfb770-6a57-41f8-9fd2-3d7a219dd75a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:05.867280 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b4bfb770-6a57-41f8-9fd2-3d7a219dd75a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:05.868078 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b4bfb770-6a57-41f8-9fd2-3d7a219dd75a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:05.868553 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b4bfb770-6a57-41f8-9fd2-3d7a219dd75a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:06.014461 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-be9a4ffb-8505-4ea6-a25b-431134493b8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:06.015511 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-be9a4ffb-8505-4ea6-a25b-431134493b8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:06.022706 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-be9a4ffb-8505-4ea6-a25b-431134493b8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:06.023492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-be9a4ffb-8505-4ea6-a25b-431134493b8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:06.025403 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-be9a4ffb-8505-4ea6-a25b-431134493b8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:06.026073 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-be9a4ffb-8505-4ea6-a25b-431134493b8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:06.050053 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b4bfb770-6a57-41f8-9fd2-3d7a219dd75a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:06.057554 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b4bfb770-6a57-41f8-9fd2-3d7a219dd75a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.210336 Jul 22 22:17:06.068470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 280/546] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:05 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:06.199333 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-be9a4ffb-8505-4ea6-a25b-431134493b8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:06.208946 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-be9a4ffb-8505-4ea6-a25b-431134493b8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:06.210709 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-be9a4ffb-8505-4ea6-a25b-431134493b8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:06.211889 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-be9a4ffb-8505-4ea6-a25b-431134493b8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1748 microversion: 2.20 time: 0.201485 Jul 22 22:17:06.212663 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 267/547] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:06 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1748 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:06.429670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-59cf3a3c-2cc3-433c-80ec-24a884668768 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:06.430205 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-59cf3a3c-2cc3-433c-80ec-24a884668768 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:06.437399 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-59cf3a3c-2cc3-433c-80ec-24a884668768 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:06.438001 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-59cf3a3c-2cc3-433c-80ec-24a884668768 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:06.439217 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-59cf3a3c-2cc3-433c-80ec-24a884668768 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:06.439903 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-59cf3a3c-2cc3-433c-80ec-24a884668768 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:06.600244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-59cf3a3c-2cc3-433c-80ec-24a884668768 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:06.608607 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-59cf3a3c-2cc3-433c-80ec-24a884668768 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.183144 Jul 22 22:17:06.609185 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 281/548] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:06 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:06.680466 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c2555a1b-1e25-42ee-8b72-743a0d4d1554 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:06.681021 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c2555a1b-1e25-42ee-8b72-743a0d4d1554 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:06.688102 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2555a1b-1e25-42ee-8b72-743a0d4d1554 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:06.688591 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2555a1b-1e25-42ee-8b72-743a0d4d1554 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:06.689371 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2555a1b-1e25-42ee-8b72-743a0d4d1554 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:06.689798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2555a1b-1e25-42ee-8b72-743a0d4d1554 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:06.863371 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c2555a1b-1e25-42ee-8b72-743a0d4d1554 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:06.864754 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c2555a1b-1e25-42ee-8b72-743a0d4d1554 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1282 microversion: 2.1 time: 0.187959 Jul 22 22:17:06.865351 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 268/549] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:06 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1282 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:07.079733 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8c87122f-479e-4fc2-b71c-4100d77e84ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:07.080860 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8c87122f-479e-4fc2-b71c-4100d77e84ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:07.090566 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c87122f-479e-4fc2-b71c-4100d77e84ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:07.091206 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c87122f-479e-4fc2-b71c-4100d77e84ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:07.092455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c87122f-479e-4fc2-b71c-4100d77e84ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:07.093910 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c87122f-479e-4fc2-b71c-4100d77e84ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:07.234244 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d33e2c5f-68d6-4851-82a7-e9fff012361d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:07.235324 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d33e2c5f-68d6-4851-82a7-e9fff012361d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:07.241996 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d33e2c5f-68d6-4851-82a7-e9fff012361d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:07.242522 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d33e2c5f-68d6-4851-82a7-e9fff012361d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:07.243362 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d33e2c5f-68d6-4851-82a7-e9fff012361d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:07.243881 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d33e2c5f-68d6-4851-82a7-e9fff012361d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:07.272158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8c87122f-479e-4fc2-b71c-4100d77e84ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:07.282702 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8c87122f-479e-4fc2-b71c-4100d77e84ee tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.210203 Jul 22 22:17:07.284057 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 282/550] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:07 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:07.404629 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d33e2c5f-68d6-4851-82a7-e9fff012361d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:07.414964 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d33e2c5f-68d6-4851-82a7-e9fff012361d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:07.415249 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d33e2c5f-68d6-4851-82a7-e9fff012361d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:07.416413 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d33e2c5f-68d6-4851-82a7-e9fff012361d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1748 microversion: 2.20 time: 0.187469 Jul 22 22:17:07.416958 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 269/551] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:07 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1748 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:07.428558 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3a4e378f-6847-4596-bddc-d660bdd38c55 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:07.429078 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3a4e378f-6847-4596-bddc-d660bdd38c55 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:07.435100 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a4e378f-6847-4596-bddc-d660bdd38c55 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:07.435551 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a4e378f-6847-4596-bddc-d660bdd38c55 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:07.436643 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a4e378f-6847-4596-bddc-d660bdd38c55 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:07.437063 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a4e378f-6847-4596-bddc-d660bdd38c55 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:07.522558 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-3a4e378f-6847-4596-bddc-d660bdd38c55 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lazy-loading 'services' on Instance uuid 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:17:07.589923 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3a4e378f-6847-4596-bddc-d660bdd38c55 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "DELETE /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57/os-volume_attachments/064decea-e3e6-4a21-a749-9744e117c749" status: 202 len: 0 microversion: 2.1 time: 0.164846 Jul 22 22:17:07.590506 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 283/552] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:17:07 2021] DELETE /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57/os-volume_attachments/064decea-e3e6-4a21-a749-9744e117c749 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:17:07.626951 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-752794b7-15b8-4bbc-9e75-a2cd2f88bf7e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:07.628362 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-752794b7-15b8-4bbc-9e75-a2cd2f88bf7e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:07.638721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-752794b7-15b8-4bbc-9e75-a2cd2f88bf7e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:07.641247 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-752794b7-15b8-4bbc-9e75-a2cd2f88bf7e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:07.642456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-752794b7-15b8-4bbc-9e75-a2cd2f88bf7e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:07.643072 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-752794b7-15b8-4bbc-9e75-a2cd2f88bf7e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:07.821124 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-752794b7-15b8-4bbc-9e75-a2cd2f88bf7e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:07.832268 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-752794b7-15b8-4bbc-9e75-a2cd2f88bf7e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.209150 Jul 22 22:17:07.832268 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 270/553] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:07 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:07.883292 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0a529853-9847-4997-bdd9-dceea1226eb5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:07.884241 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0a529853-9847-4997-bdd9-dceea1226eb5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:07.894491 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0a529853-9847-4997-bdd9-dceea1226eb5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:07.894943 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0a529853-9847-4997-bdd9-dceea1226eb5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:07.895728 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0a529853-9847-4997-bdd9-dceea1226eb5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:07.896168 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0a529853-9847-4997-bdd9-dceea1226eb5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:08.179934 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0a529853-9847-4997-bdd9-dceea1226eb5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:08.190281 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0a529853-9847-4997-bdd9-dceea1226eb5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1282 microversion: 2.1 time: 0.311040 Jul 22 22:17:08.200454 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 284/554] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:07 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1282 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:08.289681 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-04092bba-7f2c-4729-9f81-b855774d88a9 req-c52ec019-2248-4142-8e24-eff563815f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e7dd91-3f55-48c9-85aa-84c2450719f2", "name": "network-vif-plugged", "status": "completed", "tag": "e63aa00d-561e-478c-ad51-2858e1d33423"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:08.291824 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:17:08.291824 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:17:08.302340 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7763422b-44fa-452a-b9d3-df869e7bd3ec tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:08.304017 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-04092bba-7f2c-4729-9f81-b855774d88a9 req-c52ec019-2248-4142-8e24-eff563815f50 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:08.304568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7763422b-44fa-452a-b9d3-df869e7bd3ec tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:08.305023 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-04092bba-7f2c-4729-9f81-b855774d88a9 req-c52ec019-2248-4142-8e24-eff563815f50 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:08.328382 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7763422b-44fa-452a-b9d3-df869e7bd3ec tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:08.329576 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7763422b-44fa-452a-b9d3-df869e7bd3ec tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:08.331254 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7763422b-44fa-452a-b9d3-df869e7bd3ec tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:08.332429 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7763422b-44fa-452a-b9d3-df869e7bd3ec tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:08.335013 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-04092bba-7f2c-4729-9f81-b855774d88a9 req-c52ec019-2248-4142-8e24-eff563815f50 service nova] Creating event network-vif-plugged:e63aa00d-561e-478c-ad51-2858e1d33423 for instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 on hv-cinder-80186 Jul 22 22:17:08.341569 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-04092bba-7f2c-4729-9f81-b855774d88a9 req-c52ec019-2248-4142-8e24-eff563815f50 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055821 Jul 22 22:17:08.343058 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 271/555] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:17:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:17:08.438397 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-897bce4a-21e7-4c33-bd51-f902c48752f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:08.439393 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-897bce4a-21e7-4c33-bd51-f902c48752f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:08.454158 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-897bce4a-21e7-4c33-bd51-f902c48752f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:08.455528 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-897bce4a-21e7-4c33-bd51-f902c48752f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:08.456881 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-897bce4a-21e7-4c33-bd51-f902c48752f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:08.457882 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-897bce4a-21e7-4c33-bd51-f902c48752f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:08.545366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7763422b-44fa-452a-b9d3-df869e7bd3ec tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:08.554388 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7763422b-44fa-452a-b9d3-df869e7bd3ec tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.256169 Jul 22 22:17:08.555297 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 285/556] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:08 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:08.851129 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2b00cde2-2ddd-4548-8596-0e46f77748fe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:08.851910 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2b00cde2-2ddd-4548-8596-0e46f77748fe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:08.864361 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2b00cde2-2ddd-4548-8596-0e46f77748fe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:08.864856 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2b00cde2-2ddd-4548-8596-0e46f77748fe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:08.865679 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2b00cde2-2ddd-4548-8596-0e46f77748fe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:08.866302 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2b00cde2-2ddd-4548-8596-0e46f77748fe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:09.055639 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-897bce4a-21e7-4c33-bd51-f902c48752f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:09.080712 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-897bce4a-21e7-4c33-bd51-f902c48752f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:09.084959 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-897bce4a-21e7-4c33-bd51-f902c48752f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:09.086263 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-897bce4a-21e7-4c33-bd51-f902c48752f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1743 microversion: 2.20 time: 0.654435 Jul 22 22:17:09.086892 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 272/557] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:08 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1743 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:09.209117 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0c552d33-67da-4897-9eac-3b3de0ae1364 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:09.209843 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0c552d33-67da-4897-9eac-3b3de0ae1364 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:09.222766 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0c552d33-67da-4897-9eac-3b3de0ae1364 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:09.225533 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0c552d33-67da-4897-9eac-3b3de0ae1364 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:09.226478 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0c552d33-67da-4897-9eac-3b3de0ae1364 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:09.227050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0c552d33-67da-4897-9eac-3b3de0ae1364 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:09.425274 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2b00cde2-2ddd-4548-8596-0e46f77748fe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:09.437463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2b00cde2-2ddd-4548-8596-0e46f77748fe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.589066 Jul 22 22:17:09.438704 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 286/558] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:08 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:09.466228 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0c552d33-67da-4897-9eac-3b3de0ae1364 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:09.477164 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0c552d33-67da-4897-9eac-3b3de0ae1364 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.272241 Jul 22 22:17:09.478183 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 273/559] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:09 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:09.574816 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ffa537d5-5ffe-4b1a-a861-f41ac9b21318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:09.575461 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ffa537d5-5ffe-4b1a-a861-f41ac9b21318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:09.583112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ffa537d5-5ffe-4b1a-a861-f41ac9b21318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:09.584263 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ffa537d5-5ffe-4b1a-a861-f41ac9b21318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:09.585335 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ffa537d5-5ffe-4b1a-a861-f41ac9b21318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:09.585871 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ffa537d5-5ffe-4b1a-a861-f41ac9b21318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:09.958559 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ffa537d5-5ffe-4b1a-a861-f41ac9b21318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:09.987673 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ffa537d5-5ffe-4b1a-a861-f41ac9b21318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.411017 Jul 22 22:17:09.997443 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 287/560] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:09 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:10.131162 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-71078c76-0cc9-49be-bee0-587e7bc44f69 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:10.132473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-71078c76-0cc9-49be-bee0-587e7bc44f69 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:10.149974 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-71078c76-0cc9-49be-bee0-587e7bc44f69 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:10.156090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-71078c76-0cc9-49be-bee0-587e7bc44f69 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:10.156879 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-71078c76-0cc9-49be-bee0-587e7bc44f69 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:10.157733 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-71078c76-0cc9-49be-bee0-587e7bc44f69 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:10.399726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-71078c76-0cc9-49be-bee0-587e7bc44f69 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:10.412127 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-71078c76-0cc9-49be-bee0-587e7bc44f69 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:10.413729 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-71078c76-0cc9-49be-bee0-587e7bc44f69 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:10.414885 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-71078c76-0cc9-49be-bee0-587e7bc44f69 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1743 microversion: 2.20 time: 0.291872 Jul 22 22:17:10.415432 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 274/561] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:10 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1743 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:10.474490 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b8968a1a-254a-4230-afc8-c900f79ad2dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:10.475093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b8968a1a-254a-4230-afc8-c900f79ad2dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:10.484381 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8968a1a-254a-4230-afc8-c900f79ad2dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:10.485106 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8968a1a-254a-4230-afc8-c900f79ad2dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:10.486106 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8968a1a-254a-4230-afc8-c900f79ad2dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:10.486710 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8968a1a-254a-4230-afc8-c900f79ad2dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:10.498579 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-747d04a8-c1e0-4846-bab3-0712755111c6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:10.501098 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-747d04a8-c1e0-4846-bab3-0712755111c6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:10.514549 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-747d04a8-c1e0-4846-bab3-0712755111c6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:10.515901 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-747d04a8-c1e0-4846-bab3-0712755111c6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:10.519726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-747d04a8-c1e0-4846-bab3-0712755111c6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:10.521107 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-747d04a8-c1e0-4846-bab3-0712755111c6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:10.711305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b8968a1a-254a-4230-afc8-c900f79ad2dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:10.726086 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b8968a1a-254a-4230-afc8-c900f79ad2dc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.255920 Jul 22 22:17:10.726739 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 288/562] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:10 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:10.884299 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-747d04a8-c1e0-4846-bab3-0712755111c6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:10.916505 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-747d04a8-c1e0-4846-bab3-0712755111c6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.424090 Jul 22 22:17:10.924446 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 275/563] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:10 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:11.010236 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a4274784-5d6f-41be-a54e-38aa6ad4cd0b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:11.010883 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a4274784-5d6f-41be-a54e-38aa6ad4cd0b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:11.051679 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a4274784-5d6f-41be-a54e-38aa6ad4cd0b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:11.052138 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a4274784-5d6f-41be-a54e-38aa6ad4cd0b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:11.058922 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a4274784-5d6f-41be-a54e-38aa6ad4cd0b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:11.059471 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a4274784-5d6f-41be-a54e-38aa6ad4cd0b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:11.439765 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0a6ff1a3-195f-4905-acf7-8539a1569e77 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:11.440398 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0a6ff1a3-195f-4905-acf7-8539a1569e77 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:11.455054 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a6ff1a3-195f-4905-acf7-8539a1569e77 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:11.455801 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a6ff1a3-195f-4905-acf7-8539a1569e77 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:11.456769 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a6ff1a3-195f-4905-acf7-8539a1569e77 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:11.457326 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a6ff1a3-195f-4905-acf7-8539a1569e77 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:11.459861 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a4274784-5d6f-41be-a54e-38aa6ad4cd0b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:11.492221 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a4274784-5d6f-41be-a54e-38aa6ad4cd0b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1525 microversion: 2.1 time: 0.480067 Jul 22 22:17:11.503169 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 289/564] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:11 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1525 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:11.727696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0a6ff1a3-195f-4905-acf7-8539a1569e77 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:11.736177 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0a6ff1a3-195f-4905-acf7-8539a1569e77 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:11.738506 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0a6ff1a3-195f-4905-acf7-8539a1569e77 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:11.738875 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0a6ff1a3-195f-4905-acf7-8539a1569e77 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1743 microversion: 2.20 time: 0.305245 Jul 22 22:17:11.740590 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 276/565] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:11 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1743 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:11.745613 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e7853da3-6287-483d-9ca3-ff614ff117eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:11.746513 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e7853da3-6287-483d-9ca3-ff614ff117eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:11.754106 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7853da3-6287-483d-9ca3-ff614ff117eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:11.754829 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7853da3-6287-483d-9ca3-ff614ff117eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:11.755805 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7853da3-6287-483d-9ca3-ff614ff117eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:11.756440 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7853da3-6287-483d-9ca3-ff614ff117eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:11.936006 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3be9f7a2-24a0-4d37-80ee-ea504f7e0031 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:11.936685 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3be9f7a2-24a0-4d37-80ee-ea504f7e0031 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:11.946686 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3be9f7a2-24a0-4d37-80ee-ea504f7e0031 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:11.947132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3be9f7a2-24a0-4d37-80ee-ea504f7e0031 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:11.947933 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3be9f7a2-24a0-4d37-80ee-ea504f7e0031 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:11.948415 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3be9f7a2-24a0-4d37-80ee-ea504f7e0031 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:12.122796 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e7853da3-6287-483d-9ca3-ff614ff117eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:12.138950 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e7853da3-6287-483d-9ca3-ff614ff117eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.395862 Jul 22 22:17:12.140106 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 290/566] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:11 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:12.246797 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3be9f7a2-24a0-4d37-80ee-ea504f7e0031 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:12.266519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3be9f7a2-24a0-4d37-80ee-ea504f7e0031 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.335720 Jul 22 22:17:12.269476 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 277/567] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:11 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:12.512675 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d87d3ded-c726-4c0d-b17d-2fc348c8d8ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:12.513947 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d87d3ded-c726-4c0d-b17d-2fc348c8d8ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:12.527866 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d87d3ded-c726-4c0d-b17d-2fc348c8d8ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:12.528713 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d87d3ded-c726-4c0d-b17d-2fc348c8d8ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:12.530154 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d87d3ded-c726-4c0d-b17d-2fc348c8d8ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:12.530974 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d87d3ded-c726-4c0d-b17d-2fc348c8d8ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:12.763221 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-834e3d34-b062-4716-8a4c-fac98dbc57b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:12.765203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-834e3d34-b062-4716-8a4c-fac98dbc57b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:12.777770 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-834e3d34-b062-4716-8a4c-fac98dbc57b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:12.778582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-834e3d34-b062-4716-8a4c-fac98dbc57b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:12.780235 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-834e3d34-b062-4716-8a4c-fac98dbc57b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:12.784840 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-834e3d34-b062-4716-8a4c-fac98dbc57b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:12.819115 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d87d3ded-c726-4c0d-b17d-2fc348c8d8ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:12.829527 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d87d3ded-c726-4c0d-b17d-2fc348c8d8ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1505 microversion: 2.1 time: 0.322119 Jul 22 22:17:12.830491 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 291/568] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:12 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1505 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:12.848533 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3b5c3792-b65c-4f32-93d4-58b107c16c51 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:12.849471 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3b5c3792-b65c-4f32-93d4-58b107c16c51 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:12.864591 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b5c3792-b65c-4f32-93d4-58b107c16c51 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:12.866817 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b5c3792-b65c-4f32-93d4-58b107c16c51 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:12.868360 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b5c3792-b65c-4f32-93d4-58b107c16c51 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:12.869308 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b5c3792-b65c-4f32-93d4-58b107c16c51 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:13.082899 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-834e3d34-b062-4716-8a4c-fac98dbc57b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:13.116497 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-834e3d34-b062-4716-8a4c-fac98dbc57b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:13.119448 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-834e3d34-b062-4716-8a4c-fac98dbc57b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:13.126338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-834e3d34-b062-4716-8a4c-fac98dbc57b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1743 microversion: 2.20 time: 0.366572 Jul 22 22:17:13.144176 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 278/569] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:12 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1743 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:13.161743 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-49342af7-5c59-43bf-80ce-a85aee3d8c97 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:13.162301 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-49342af7-5c59-43bf-80ce-a85aee3d8c97 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:13.179479 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49342af7-5c59-43bf-80ce-a85aee3d8c97 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:13.180364 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49342af7-5c59-43bf-80ce-a85aee3d8c97 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:13.182518 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49342af7-5c59-43bf-80ce-a85aee3d8c97 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:13.183184 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49342af7-5c59-43bf-80ce-a85aee3d8c97 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:13.298863 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3b5c3792-b65c-4f32-93d4-58b107c16c51 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:13.331197 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3b5c3792-b65c-4f32-93d4-58b107c16c51 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1520 microversion: 2.1 time: 0.487497 Jul 22 22:17:13.345712 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 292/570] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:12 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1520 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:13.353026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3073b964-23b9-449a-9a1f-c7b0746c0598 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:13.353650 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3073b964-23b9-449a-9a1f-c7b0746c0598 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:13.375222 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3073b964-23b9-449a-9a1f-c7b0746c0598 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:13.375533 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3073b964-23b9-449a-9a1f-c7b0746c0598 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:13.376367 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3073b964-23b9-449a-9a1f-c7b0746c0598 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:13.376804 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3073b964-23b9-449a-9a1f-c7b0746c0598 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:13.428229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-49342af7-5c59-43bf-80ce-a85aee3d8c97 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:13.441080 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-49342af7-5c59-43bf-80ce-a85aee3d8c97 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.284370 Jul 22 22:17:13.443542 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 279/571] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:13 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:13.567157 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-10556114-29dd-4b2c-81f1-47d04938a948 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:13.569306 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-10556114-29dd-4b2c-81f1-47d04938a948 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:13.596680 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-10556114-29dd-4b2c-81f1-47d04938a948 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:13.601582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-10556114-29dd-4b2c-81f1-47d04938a948 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:13.605277 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-10556114-29dd-4b2c-81f1-47d04938a948 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:13.611814 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-10556114-29dd-4b2c-81f1-47d04938a948 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:13.673751 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-10556114-29dd-4b2c-81f1-47d04938a948 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:17:13.881718 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3073b964-23b9-449a-9a1f-c7b0746c0598 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:13.898076 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-10556114-29dd-4b2c-81f1-47d04938a948 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "DELETE /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 204 len: 0 microversion: 2.1 time: 0.335058 Jul 22 22:17:13.898945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 280/572] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:17:13 2021] DELETE /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:17:13.903903 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3073b964-23b9-449a-9a1f-c7b0746c0598 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.556454 Jul 22 22:17:13.907136 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 293/573] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:13 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:13.920991 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1d45c99c-93c1-46f8-9bec-20eced398c28 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:13.920991 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1d45c99c-93c1-46f8-9bec-20eced398c28 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:13.932712 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1d45c99c-93c1-46f8-9bec-20eced398c28 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:13.946127 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1d45c99c-93c1-46f8-9bec-20eced398c28 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:13.947650 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1d45c99c-93c1-46f8-9bec-20eced398c28 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:13.948119 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1d45c99c-93c1-46f8-9bec-20eced398c28 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:14.147676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-576f6b2e-6c71-4fb4-8429-8390b2ffcb81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:14.148231 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-576f6b2e-6c71-4fb4-8429-8390b2ffcb81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:14.156037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-576f6b2e-6c71-4fb4-8429-8390b2ffcb81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:14.156837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-576f6b2e-6c71-4fb4-8429-8390b2ffcb81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:14.157841 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-576f6b2e-6c71-4fb4-8429-8390b2ffcb81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:14.158535 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-576f6b2e-6c71-4fb4-8429-8390b2ffcb81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:14.271961 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1d45c99c-93c1-46f8-9bec-20eced398c28 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:14.289594 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1d45c99c-93c1-46f8-9bec-20eced398c28 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1517 microversion: 2.1 time: 0.380950 Jul 22 22:17:14.290777 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 281/574] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:13 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1517 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:14.445555 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-576f6b2e-6c71-4fb4-8429-8390b2ffcb81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:14.455792 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-576f6b2e-6c71-4fb4-8429-8390b2ffcb81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:14.457518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-576f6b2e-6c71-4fb4-8429-8390b2ffcb81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:14.458912 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-576f6b2e-6c71-4fb4-8429-8390b2ffcb81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1743 microversion: 2.20 time: 0.315608 Jul 22 22:17:14.459687 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 294/575] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:14 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1743 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:14.469747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-486b34b3-8bf9-4f5f-9690-43ad34768756 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:14.470768 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-486b34b3-8bf9-4f5f-9690-43ad34768756 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:14.479111 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-486b34b3-8bf9-4f5f-9690-43ad34768756 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:14.479852 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-486b34b3-8bf9-4f5f-9690-43ad34768756 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:14.481048 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-486b34b3-8bf9-4f5f-9690-43ad34768756 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:14.481660 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-486b34b3-8bf9-4f5f-9690-43ad34768756 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:14.751774 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-486b34b3-8bf9-4f5f-9690-43ad34768756 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:14.769816 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-486b34b3-8bf9-4f5f-9690-43ad34768756 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.303524 Jul 22 22:17:14.771650 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 282/576] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:14 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:14.937090 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e07dc5ad-ac06-4108-adde-e4da2c2d0374 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:14.939212 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e07dc5ad-ac06-4108-adde-e4da2c2d0374 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:14.950058 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e07dc5ad-ac06-4108-adde-e4da2c2d0374 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:14.951273 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e07dc5ad-ac06-4108-adde-e4da2c2d0374 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:14.953611 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e07dc5ad-ac06-4108-adde-e4da2c2d0374 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:14.954569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e07dc5ad-ac06-4108-adde-e4da2c2d0374 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:15.182238 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e07dc5ad-ac06-4108-adde-e4da2c2d0374 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:15.192686 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e07dc5ad-ac06-4108-adde-e4da2c2d0374 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.262150 Jul 22 22:17:15.214027 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 295/577] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:14 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:15.292186 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d0f5a54d-5b90-457d-9e7c-a2b7f50c4e54 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:15.298586 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d0f5a54d-5b90-457d-9e7c-a2b7f50c4e54 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:15.311428 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3a5eefb4-58dd-4676-8339-3556927050b2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:15.312828 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3a5eefb4-58dd-4676-8339-3556927050b2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:15.330881 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a5eefb4-58dd-4676-8339-3556927050b2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:15.341935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d0f5a54d-5b90-457d-9e7c-a2b7f50c4e54 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:15.343692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a5eefb4-58dd-4676-8339-3556927050b2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:15.345819 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a5eefb4-58dd-4676-8339-3556927050b2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:15.346691 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d0f5a54d-5b90-457d-9e7c-a2b7f50c4e54 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:15.348074 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d0f5a54d-5b90-457d-9e7c-a2b7f50c4e54 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:15.348891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a5eefb4-58dd-4676-8339-3556927050b2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:15.349832 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d0f5a54d-5b90-457d-9e7c-a2b7f50c4e54 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:15.406714 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.objects.instance [None req-d0f5a54d-5b90-457d-9e7c-a2b7f50c4e54 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lazy-loading 'flavor' on Instance uuid c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae {{(pid=107498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:17:15.540081 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d0f5a54d-5b90-457d-9e7c-a2b7f50c4e54 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/action" status: 200 len: 32 microversion: 2.1 time: 0.260144 Jul 22 22:17:15.542656 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 283/578] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:17:15 2021] POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/action => generated 32 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:17:15.554344 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-057e4608-2129-452e-baa9-c37d3278c308 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:15.560393 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-057e4608-2129-452e-baa9-c37d3278c308 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:15.595796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-057e4608-2129-452e-baa9-c37d3278c308 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:15.601546 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-057e4608-2129-452e-baa9-c37d3278c308 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:15.604720 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-057e4608-2129-452e-baa9-c37d3278c308 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:15.605711 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-057e4608-2129-452e-baa9-c37d3278c308 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:15.738516 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3a5eefb4-58dd-4676-8339-3556927050b2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:15.756575 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3a5eefb4-58dd-4676-8339-3556927050b2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1517 microversion: 2.1 time: 0.453096 Jul 22 22:17:15.757842 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 296/579] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:15 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1517 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:15.766462 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-eac916e2-04cb-41ca-a9aa-c1ebf9c64bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:15.781110 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-eac916e2-04cb-41ca-a9aa-c1ebf9c64bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:15.803013 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eac916e2-04cb-41ca-a9aa-c1ebf9c64bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:15.803974 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eac916e2-04cb-41ca-a9aa-c1ebf9c64bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:15.805202 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eac916e2-04cb-41ca-a9aa-c1ebf9c64bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:15.806273 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eac916e2-04cb-41ca-a9aa-c1ebf9c64bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:16.115700 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-eac916e2-04cb-41ca-a9aa-c1ebf9c64bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:16.126236 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-eac916e2-04cb-41ca-a9aa-c1ebf9c64bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.367106 Jul 22 22:17:16.137384 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 297/580] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:15 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:16.149102 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-833f3655-80a1-4ffc-b490-573cde99a6ae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:16.149976 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-833f3655-80a1-4ffc-b490-573cde99a6ae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:16.157430 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-833f3655-80a1-4ffc-b490-573cde99a6ae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:16.158638 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-833f3655-80a1-4ffc-b490-573cde99a6ae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:16.159620 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-833f3655-80a1-4ffc-b490-573cde99a6ae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:16.160759 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-833f3655-80a1-4ffc-b490-573cde99a6ae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:16.258106 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-057e4608-2129-452e-baa9-c37d3278c308 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:16.267829 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-057e4608-2129-452e-baa9-c37d3278c308 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:16.269420 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-057e4608-2129-452e-baa9-c37d3278c308 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:16.270640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-057e4608-2129-452e-baa9-c37d3278c308 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1743 microversion: 2.20 time: 0.724758 Jul 22 22:17:16.287085 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 284/581] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:15 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1743 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:16.292181 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-371d4ec9-5c39-4491-b7fa-5654fb1e4548 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:16.292836 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-371d4ec9-5c39-4491-b7fa-5654fb1e4548 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:16.323214 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-371d4ec9-5c39-4491-b7fa-5654fb1e4548 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:16.324065 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-371d4ec9-5c39-4491-b7fa-5654fb1e4548 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:16.325527 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-371d4ec9-5c39-4491-b7fa-5654fb1e4548 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:16.326854 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-371d4ec9-5c39-4491-b7fa-5654fb1e4548 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:16.425013 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-833f3655-80a1-4ffc-b490-573cde99a6ae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:16.440739 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-833f3655-80a1-4ffc-b490-573cde99a6ae tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.301780 Jul 22 22:17:16.452712 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 298/582] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:16 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:16.726342 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-371d4ec9-5c39-4491-b7fa-5654fb1e4548 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:16.735223 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-371d4ec9-5c39-4491-b7fa-5654fb1e4548 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.446538 Jul 22 22:17:16.740184 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 285/583] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:16 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:16.774935 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-aef4dbbe-fd37-42dd-96f0-08afac72659a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:16.775555 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-aef4dbbe-fd37-42dd-96f0-08afac72659a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:16.785084 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aef4dbbe-fd37-42dd-96f0-08afac72659a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:16.786942 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aef4dbbe-fd37-42dd-96f0-08afac72659a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:16.789094 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aef4dbbe-fd37-42dd-96f0-08afac72659a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:16.790018 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aef4dbbe-fd37-42dd-96f0-08afac72659a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:17.148438 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-aef4dbbe-fd37-42dd-96f0-08afac72659a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:17.174741 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2297fa3f-de17-4e52-bc01-dfa1428f1805 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:17.175368 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2297fa3f-de17-4e52-bc01-dfa1428f1805 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:17.181481 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-aef4dbbe-fd37-42dd-96f0-08afac72659a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1517 microversion: 2.1 time: 0.409863 Jul 22 22:17:17.183683 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 299/584] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:16 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1517 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:17.190567 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2297fa3f-de17-4e52-bc01-dfa1428f1805 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:17.191351 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2297fa3f-de17-4e52-bc01-dfa1428f1805 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:17.192534 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2297fa3f-de17-4e52-bc01-dfa1428f1805 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:17.193209 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2297fa3f-de17-4e52-bc01-dfa1428f1805 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:17.293717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4983a442-50f9-4a7d-89b4-699a7d9ebe58 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:17.297328 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4983a442-50f9-4a7d-89b4-699a7d9ebe58 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:17.317659 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4983a442-50f9-4a7d-89b4-699a7d9ebe58 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:17.319480 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4983a442-50f9-4a7d-89b4-699a7d9ebe58 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:17.321011 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4983a442-50f9-4a7d-89b4-699a7d9ebe58 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:17.328105 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4983a442-50f9-4a7d-89b4-699a7d9ebe58 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:17.562817 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2297fa3f-de17-4e52-bc01-dfa1428f1805 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:17.572022 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2297fa3f-de17-4e52-bc01-dfa1428f1805 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.405353 Jul 22 22:17:17.573299 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 286/585] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:17 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:17.579186 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-73ee2ba2-271a-4a39-9792-e06dddb846d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:17.580081 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-73ee2ba2-271a-4a39-9792-e06dddb846d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:17.594008 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-73ee2ba2-271a-4a39-9792-e06dddb846d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:17.594807 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-73ee2ba2-271a-4a39-9792-e06dddb846d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:17.595788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-73ee2ba2-271a-4a39-9792-e06dddb846d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:17.596439 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-73ee2ba2-271a-4a39-9792-e06dddb846d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:17.657439 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4983a442-50f9-4a7d-89b4-699a7d9ebe58 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:17.667506 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4983a442-50f9-4a7d-89b4-699a7d9ebe58 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:17.669770 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4983a442-50f9-4a7d-89b4-699a7d9ebe58 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:17.672097 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4983a442-50f9-4a7d-89b4-699a7d9ebe58 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1743 microversion: 2.20 time: 0.384204 Jul 22 22:17:17.672947 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 300/586] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:17 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1743 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:17.756902 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-98c899aa-c863-40f7-909d-062ac1172e15 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:17.757891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-98c899aa-c863-40f7-909d-062ac1172e15 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:17.781543 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-98c899aa-c863-40f7-909d-062ac1172e15 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:17.787708 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-98c899aa-c863-40f7-909d-062ac1172e15 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:17.789164 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-98c899aa-c863-40f7-909d-062ac1172e15 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:17.789773 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-98c899aa-c863-40f7-909d-062ac1172e15 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:17.880312 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-73ee2ba2-271a-4a39-9792-e06dddb846d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:17.900296 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-73ee2ba2-271a-4a39-9792-e06dddb846d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.325731 Jul 22 22:17:17.901785 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 287/587] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:17 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:18.111273 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-98c899aa-c863-40f7-909d-062ac1172e15 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:18.137528 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-98c899aa-c863-40f7-909d-062ac1172e15 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.384834 Jul 22 22:17:18.142920 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 301/588] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:17 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:18.207185 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f6de9606-b6d1-4e92-9ce9-0230b07fa124 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:18.208123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f6de9606-b6d1-4e92-9ce9-0230b07fa124 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:18.226888 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f6de9606-b6d1-4e92-9ce9-0230b07fa124 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:18.231703 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f6de9606-b6d1-4e92-9ce9-0230b07fa124 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:18.233780 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f6de9606-b6d1-4e92-9ce9-0230b07fa124 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:18.234605 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f6de9606-b6d1-4e92-9ce9-0230b07fa124 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:18.463676 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f6de9606-b6d1-4e92-9ce9-0230b07fa124 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:18.474288 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f6de9606-b6d1-4e92-9ce9-0230b07fa124 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1517 microversion: 2.1 time: 0.272136 Jul 22 22:17:18.481464 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 288/589] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:18 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1517 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:18.595598 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f1e37e66-3b48-4a27-adeb-c291b127ab7e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:18.597206 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f1e37e66-3b48-4a27-adeb-c291b127ab7e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:18.611791 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f1e37e66-3b48-4a27-adeb-c291b127ab7e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:18.612755 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f1e37e66-3b48-4a27-adeb-c291b127ab7e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:18.613885 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f1e37e66-3b48-4a27-adeb-c291b127ab7e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:18.618420 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f1e37e66-3b48-4a27-adeb-c291b127ab7e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:18.703199 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-188395ad-9b2a-4f0e-81c1-49d9bc38dc34 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:18.703777 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-188395ad-9b2a-4f0e-81c1-49d9bc38dc34 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:18.718537 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-188395ad-9b2a-4f0e-81c1-49d9bc38dc34 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:18.718983 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-188395ad-9b2a-4f0e-81c1-49d9bc38dc34 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:18.719822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-188395ad-9b2a-4f0e-81c1-49d9bc38dc34 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:18.720551 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-188395ad-9b2a-4f0e-81c1-49d9bc38dc34 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:18.862603 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f1e37e66-3b48-4a27-adeb-c291b127ab7e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:18.870746 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f1e37e66-3b48-4a27-adeb-c291b127ab7e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.279657 Jul 22 22:17:18.871561 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 302/590] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:18 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:18.919588 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8fe105f0-b0e0-48df-aad7-c0076a0a0684 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:18.920517 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8fe105f0-b0e0-48df-aad7-c0076a0a0684 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:18.939552 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8fe105f0-b0e0-48df-aad7-c0076a0a0684 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:18.940009 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8fe105f0-b0e0-48df-aad7-c0076a0a0684 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:18.940891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8fe105f0-b0e0-48df-aad7-c0076a0a0684 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:18.941329 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8fe105f0-b0e0-48df-aad7-c0076a0a0684 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:19.201604 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-188395ad-9b2a-4f0e-81c1-49d9bc38dc34 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:19.217813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-188395ad-9b2a-4f0e-81c1-49d9bc38dc34 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:19.225993 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-188395ad-9b2a-4f0e-81c1-49d9bc38dc34 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:19.229981 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-188395ad-9b2a-4f0e-81c1-49d9bc38dc34 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1743 microversion: 2.20 time: 0.530759 Jul 22 22:17:19.251547 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 289/591] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:18 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1743 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:19.294797 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-74163738-6dae-4778-a867-4a02d439339d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:19.304969 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8fe105f0-b0e0-48df-aad7-c0076a0a0684 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:19.317235 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8fe105f0-b0e0-48df-aad7-c0076a0a0684 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1730 microversion: 2.1 time: 0.401816 Jul 22 22:17:19.319681 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-74163738-6dae-4778-a867-4a02d439339d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:19.328037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 303/592] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:18 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1730 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:19.346494 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-74163738-6dae-4778-a867-4a02d439339d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:19.347870 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-74163738-6dae-4778-a867-4a02d439339d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:19.351575 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-74163738-6dae-4778-a867-4a02d439339d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:19.355237 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-74163738-6dae-4778-a867-4a02d439339d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:19.496451 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5ccd94d8-4c7a-46a6-add2-3d1ff2bb24f0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:19.497458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5ccd94d8-4c7a-46a6-add2-3d1ff2bb24f0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:19.517636 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ccd94d8-4c7a-46a6-add2-3d1ff2bb24f0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:19.520989 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ccd94d8-4c7a-46a6-add2-3d1ff2bb24f0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:19.531680 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ccd94d8-4c7a-46a6-add2-3d1ff2bb24f0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:19.539152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ccd94d8-4c7a-46a6-add2-3d1ff2bb24f0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:19.958366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5ccd94d8-4c7a-46a6-add2-3d1ff2bb24f0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:19.973602 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5ccd94d8-4c7a-46a6-add2-3d1ff2bb24f0 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1517 microversion: 2.1 time: 0.482484 Jul 22 22:17:19.974215 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 304/593] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:19 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1517 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:19.984782 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-921e206a-2d2e-4c15-9b1d-5bc2886eb05d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:19.985302 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-921e206a-2d2e-4c15-9b1d-5bc2886eb05d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:20.001951 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-921e206a-2d2e-4c15-9b1d-5bc2886eb05d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:20.002411 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-921e206a-2d2e-4c15-9b1d-5bc2886eb05d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:20.003707 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-921e206a-2d2e-4c15-9b1d-5bc2886eb05d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:20.004708 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-921e206a-2d2e-4c15-9b1d-5bc2886eb05d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:20.405140 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-921e206a-2d2e-4c15-9b1d-5bc2886eb05d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:20.449134 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-921e206a-2d2e-4c15-9b1d-5bc2886eb05d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.471820 Jul 22 22:17:20.457079 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 305/594] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:19 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:20.502887 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a8901d44-c0a8-44f9-a12f-2e17ec1feef2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:20.516912 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a8901d44-c0a8-44f9-a12f-2e17ec1feef2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:20.534597 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a8901d44-c0a8-44f9-a12f-2e17ec1feef2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:20.535196 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a8901d44-c0a8-44f9-a12f-2e17ec1feef2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:20.536810 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a8901d44-c0a8-44f9-a12f-2e17ec1feef2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:20.537541 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a8901d44-c0a8-44f9-a12f-2e17ec1feef2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:20.581469 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-74163738-6dae-4778-a867-4a02d439339d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:20.621933 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-74163738-6dae-4778-a867-4a02d439339d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 1.350420 Jul 22 22:17:20.625189 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 290/595] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:19 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:20.639661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0ac84daa-fa1c-4428-96c9-86ea7ad6f7f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:20.645549 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0ac84daa-fa1c-4428-96c9-86ea7ad6f7f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:20.664162 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ac84daa-fa1c-4428-96c9-86ea7ad6f7f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:20.670269 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ac84daa-fa1c-4428-96c9-86ea7ad6f7f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:20.672713 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ac84daa-fa1c-4428-96c9-86ea7ad6f7f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:20.673771 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ac84daa-fa1c-4428-96c9-86ea7ad6f7f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:20.843293 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a8901d44-c0a8-44f9-a12f-2e17ec1feef2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:20.873785 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a8901d44-c0a8-44f9-a12f-2e17ec1feef2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:20.875643 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a8901d44-c0a8-44f9-a12f-2e17ec1feef2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:20.876873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a8901d44-c0a8-44f9-a12f-2e17ec1feef2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1743 microversion: 2.20 time: 0.418022 Jul 22 22:17:20.877843 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 306/596] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:20 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1743 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:20.911727 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-9710308b-4de0-455d-b5fa-9669020b59e8 req-bcc82a64-8b14-4918-b53e-5f09dd74c457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4e9f7e-0dbd-462c-a906-28fc0b57fa57", "name": "network-vif-deleted", "tag": "92535272-b7aa-4912-9315-13139c6d3169"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:20.914720 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:17:20.914720 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:17:20.945918 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-9710308b-4de0-455d-b5fa-9669020b59e8 req-bcc82a64-8b14-4918-b53e-5f09dd74c457 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:20.946396 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-9710308b-4de0-455d-b5fa-9669020b59e8 req-bcc82a64-8b14-4918-b53e-5f09dd74c457 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:20.978859 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-9710308b-4de0-455d-b5fa-9669020b59e8 req-bcc82a64-8b14-4918-b53e-5f09dd74c457 service nova] Creating event network-vif-deleted:92535272-b7aa-4912-9315-13139c6d3169 for instance 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 on hv-cinder-80186 Jul 22 22:17:20.989366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-9710308b-4de0-455d-b5fa-9669020b59e8 req-bcc82a64-8b14-4918-b53e-5f09dd74c457 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109661 Jul 22 22:17:20.990104 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 307/597] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:17:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:17:21.007997 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8c8304b8-a9ea-46bc-9a3a-b7f62dd582f2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:21.008974 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8c8304b8-a9ea-46bc-9a3a-b7f62dd582f2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:21.023972 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c8304b8-a9ea-46bc-9a3a-b7f62dd582f2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:21.024545 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c8304b8-a9ea-46bc-9a3a-b7f62dd582f2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:21.025335 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c8304b8-a9ea-46bc-9a3a-b7f62dd582f2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:21.025762 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c8304b8-a9ea-46bc-9a3a-b7f62dd582f2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:21.091274 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0ac84daa-fa1c-4428-96c9-86ea7ad6f7f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:21.100178 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c8304b8-a9ea-46bc-9a3a-b7f62dd582f2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:21.100801 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8c8304b8-a9ea-46bc-9a3a-b7f62dd582f2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:21.101271 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-8c8304b8-a9ea-46bc-9a3a-b7f62dd582f2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lazy-loading 'fault' on Instance uuid 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:17:21.116752 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0ac84daa-fa1c-4428-96c9-86ea7ad6f7f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1707 microversion: 2.1 time: 0.485674 Jul 22 22:17:21.118852 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 291/598] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:20 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1707 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:21.136309 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bb04283b-49d0-4c85-96d6-cc91959dbdf1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:21.147476 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bb04283b-49d0-4c85-96d6-cc91959dbdf1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:21.147934 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bb04283b-49d0-4c85-96d6-cc91959dbdf1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:21.214543 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8c8304b8-a9ea-46bc-9a3a-b7f62dd582f2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:21.227899 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8c8304b8-a9ea-46bc-9a3a-b7f62dd582f2 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 200 len: 1312 microversion: 2.1 time: 0.225784 Jul 22 22:17:21.240628 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 308/599] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:20 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 1312 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:21.242915 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bb04283b-49d0-4c85-96d6-cc91959dbdf1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Going to try to start instance {{(pid=107498) start /opt/stack/nova/nova/compute/api.py:2605}} Jul 22 22:17:21.382788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bb04283b-49d0-4c85-96d6-cc91959dbdf1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 202 len: 0 microversion: 2.1 time: 0.245887 Jul 22 22:17:21.382788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 292/600] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:17:21 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:17:21.407743 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0f83e854-d96d-4473-8719-7b9db277e584 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:21.409818 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0f83e854-d96d-4473-8719-7b9db277e584 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:21.434648 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0f83e854-d96d-4473-8719-7b9db277e584 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:21.439076 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0f83e854-d96d-4473-8719-7b9db277e584 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:21.440563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0f83e854-d96d-4473-8719-7b9db277e584 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:21.441505 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0f83e854-d96d-4473-8719-7b9db277e584 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:21.490519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cfa49f17-d582-4872-b560-71422d851dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:21.492861 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cfa49f17-d582-4872-b560-71422d851dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:21.509182 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cfa49f17-d582-4872-b560-71422d851dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:21.510223 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cfa49f17-d582-4872-b560-71422d851dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:21.522069 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cfa49f17-d582-4872-b560-71422d851dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:21.523550 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cfa49f17-d582-4872-b560-71422d851dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:21.791773 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0f83e854-d96d-4473-8719-7b9db277e584 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:21.801622 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0f83e854-d96d-4473-8719-7b9db277e584 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1716 microversion: 2.1 time: 0.415731 Jul 22 22:17:21.808078 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 309/601] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:21 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1716 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:21.826143 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6ea2e20d-4443-42a8-bc35-0d3a4c1cc94d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:21.827907 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6ea2e20d-4443-42a8-bc35-0d3a4c1cc94d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:21.865696 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ea2e20d-4443-42a8-bc35-0d3a4c1cc94d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:21.866790 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ea2e20d-4443-42a8-bc35-0d3a4c1cc94d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:21.871263 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ea2e20d-4443-42a8-bc35-0d3a4c1cc94d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:21.875567 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ea2e20d-4443-42a8-bc35-0d3a4c1cc94d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:21.975187 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cfa49f17-d582-4872-b560-71422d851dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:21.992887 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cfa49f17-d582-4872-b560-71422d851dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.525110 Jul 22 22:17:21.994896 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 293/602] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:21 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:22.005143 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-95ba5216-f2c4-4797-a8b5-db663cff0dc1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:22.006884 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-95ba5216-f2c4-4797-a8b5-db663cff0dc1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:22.037209 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95ba5216-f2c4-4797-a8b5-db663cff0dc1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:22.055560 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95ba5216-f2c4-4797-a8b5-db663cff0dc1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:22.061876 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95ba5216-f2c4-4797-a8b5-db663cff0dc1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:22.070203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95ba5216-f2c4-4797-a8b5-db663cff0dc1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:22.437128 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-95ba5216-f2c4-4797-a8b5-db663cff0dc1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:22.448047 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-95ba5216-f2c4-4797-a8b5-db663cff0dc1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:22.457456 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6ea2e20d-4443-42a8-bc35-0d3a4c1cc94d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:22.461060 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-95ba5216-f2c4-4797-a8b5-db663cff0dc1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:22.466513 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6ea2e20d-4443-42a8-bc35-0d3a4c1cc94d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.656915 Jul 22 22:17:22.469301 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-95ba5216-f2c4-4797-a8b5-db663cff0dc1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1743 microversion: 2.20 time: 0.472172 Jul 22 22:17:22.469692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 310/603] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:21 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:22.470451 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 294/604] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:21 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1743 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:22.478289 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-856193e2-8836-4ceb-84e9-7bd3808d2bcc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:22.483156 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-856193e2-8836-4ceb-84e9-7bd3808d2bcc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:22.497916 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-856193e2-8836-4ceb-84e9-7bd3808d2bcc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:22.499618 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-856193e2-8836-4ceb-84e9-7bd3808d2bcc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:22.502906 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-856193e2-8836-4ceb-84e9-7bd3808d2bcc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:22.503873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-856193e2-8836-4ceb-84e9-7bd3808d2bcc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:22.530806 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-856193e2-8836-4ceb-84e9-7bd3808d2bcc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] HTTP exception thrown: Instance 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 could not be found. Jul 22 22:17:22.535657 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-856193e2-8836-4ceb-84e9-7bd3808d2bcc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Returning 404 to user: Instance 9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:17:22.536785 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-856193e2-8836-4ceb-84e9-7bd3808d2bcc tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57" status: 404 len: 111 microversion: 2.1 time: 0.065368 Jul 22 22:17:22.537932 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 311/605] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:22 2021] GET /compute/v2.1/servers/9e4e9f7e-0dbd-462c-a906-28fc0b57fa57 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:17:22.823291 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fe8ab373-6a46-471b-b929-5c5edc9dc608 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:22.824034 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fe8ab373-6a46-471b-b929-5c5edc9dc608 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:22.835600 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe8ab373-6a46-471b-b929-5c5edc9dc608 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:22.836074 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe8ab373-6a46-471b-b929-5c5edc9dc608 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:22.850251 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe8ab373-6a46-471b-b929-5c5edc9dc608 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:22.850656 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe8ab373-6a46-471b-b929-5c5edc9dc608 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:23.014605 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3af0374f-89de-43f7-a0a2-68ad76e64fcb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:23.016876 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3af0374f-89de-43f7-a0a2-68ad76e64fcb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:23.033300 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3af0374f-89de-43f7-a0a2-68ad76e64fcb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:23.035648 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3af0374f-89de-43f7-a0a2-68ad76e64fcb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:23.037091 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3af0374f-89de-43f7-a0a2-68ad76e64fcb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:23.040093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3af0374f-89de-43f7-a0a2-68ad76e64fcb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:23.267672 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3af0374f-89de-43f7-a0a2-68ad76e64fcb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:23.279518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3af0374f-89de-43f7-a0a2-68ad76e64fcb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.270977 Jul 22 22:17:23.280664 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 312/606] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:23 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:23.339299 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fe8ab373-6a46-471b-b929-5c5edc9dc608 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:23.355600 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fe8ab373-6a46-471b-b929-5c5edc9dc608 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1716 microversion: 2.1 time: 0.536201 Jul 22 22:17:23.356399 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 295/607] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:22 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1716 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:23.490047 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0d58c534-15cc-4005-858b-b0ca8513de0d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:23.490911 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0d58c534-15cc-4005-858b-b0ca8513de0d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:23.501741 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3bc1db35-1186-401b-9608-4df9f114a9b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:23.502352 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d58c534-15cc-4005-858b-b0ca8513de0d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:23.503193 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3bc1db35-1186-401b-9608-4df9f114a9b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:23.503932 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d58c534-15cc-4005-858b-b0ca8513de0d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:23.505138 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d58c534-15cc-4005-858b-b0ca8513de0d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:23.505698 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d58c534-15cc-4005-858b-b0ca8513de0d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:23.513267 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3bc1db35-1186-401b-9608-4df9f114a9b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:23.514301 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3bc1db35-1186-401b-9608-4df9f114a9b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:23.515336 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3bc1db35-1186-401b-9608-4df9f114a9b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:23.515813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3bc1db35-1186-401b-9608-4df9f114a9b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:23.685280 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3bc1db35-1186-401b-9608-4df9f114a9b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:23.695492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3bc1db35-1186-401b-9608-4df9f114a9b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:23.697119 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3bc1db35-1186-401b-9608-4df9f114a9b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:23.698282 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3bc1db35-1186-401b-9608-4df9f114a9b6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1743 microversion: 2.20 time: 0.202785 Jul 22 22:17:23.699395 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 296/608] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:23 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:23.722983 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0d58c534-15cc-4005-858b-b0ca8513de0d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:23.736203 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0d58c534-15cc-4005-858b-b0ca8513de0d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.250664 Jul 22 22:17:23.738897 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 313/609] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:23 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:23.768346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4db5e36e-8336-427f-ba6d-6d5b290bfcd1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:23.769447 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4db5e36e-8336-427f-ba6d-6d5b290bfcd1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:23.776503 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4db5e36e-8336-427f-ba6d-6d5b290bfcd1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:23.777210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4db5e36e-8336-427f-ba6d-6d5b290bfcd1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:23.778037 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4db5e36e-8336-427f-ba6d-6d5b290bfcd1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:23.778476 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4db5e36e-8336-427f-ba6d-6d5b290bfcd1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:23.812414 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4db5e36e-8336-427f-ba6d-6d5b290bfcd1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:17:23.903699 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4db5e36e-8336-427f-ba6d-6d5b290bfcd1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "DELETE /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 204 len: 0 microversion: 2.1 time: 0.140593 Jul 22 22:17:23.905111 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 297/610] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:17:23 2021] DELETE /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 22 22:17:23.914649 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-dd7a7f81-9ba0-4168-bd53-6eeb139eaa73 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:23.915298 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-dd7a7f81-9ba0-4168-bd53-6eeb139eaa73 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:23.922303 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dd7a7f81-9ba0-4168-bd53-6eeb139eaa73 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:23.922938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dd7a7f81-9ba0-4168-bd53-6eeb139eaa73 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:23.924491 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dd7a7f81-9ba0-4168-bd53-6eeb139eaa73 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:23.925122 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dd7a7f81-9ba0-4168-bd53-6eeb139eaa73 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:24.114116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-dd7a7f81-9ba0-4168-bd53-6eeb139eaa73 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:24.124584 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-dd7a7f81-9ba0-4168-bd53-6eeb139eaa73 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1518 microversion: 2.1 time: 0.214219 Jul 22 22:17:24.125129 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 314/611] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:23 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1518 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:24.298457 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-44663b1c-1a9b-45ea-abb0-e851dae5fd79 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:24.299556 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-44663b1c-1a9b-45ea-abb0-e851dae5fd79 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:24.306962 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-44663b1c-1a9b-45ea-abb0-e851dae5fd79 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:24.307410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-44663b1c-1a9b-45ea-abb0-e851dae5fd79 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:24.308208 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-44663b1c-1a9b-45ea-abb0-e851dae5fd79 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:24.308696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-44663b1c-1a9b-45ea-abb0-e851dae5fd79 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:24.374834 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b22e9568-c34c-44b9-b3f5-3a7bd879bc04 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:24.375829 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b22e9568-c34c-44b9-b3f5-3a7bd879bc04 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:24.382694 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b22e9568-c34c-44b9-b3f5-3a7bd879bc04 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:24.383276 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b22e9568-c34c-44b9-b3f5-3a7bd879bc04 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:24.384223 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b22e9568-c34c-44b9-b3f5-3a7bd879bc04 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:24.384699 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b22e9568-c34c-44b9-b3f5-3a7bd879bc04 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:24.506962 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-44663b1c-1a9b-45ea-abb0-e851dae5fd79 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:24.517434 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-44663b1c-1a9b-45ea-abb0-e851dae5fd79 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.223696 Jul 22 22:17:24.518363 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 298/612] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:24 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:24.568139 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b22e9568-c34c-44b9-b3f5-3a7bd879bc04 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:24.577443 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b22e9568-c34c-44b9-b3f5-3a7bd879bc04 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1716 microversion: 2.1 time: 0.207582 Jul 22 22:17:24.578473 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 315/613] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:24 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1716 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:24.724991 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e9a5ae0d-02d2-4f11-828c-ef08992a9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:24.726149 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e9a5ae0d-02d2-4f11-828c-ef08992a9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:24.737434 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e9a5ae0d-02d2-4f11-828c-ef08992a9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:24.738221 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e9a5ae0d-02d2-4f11-828c-ef08992a9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:24.739689 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e9a5ae0d-02d2-4f11-828c-ef08992a9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:24.740522 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e9a5ae0d-02d2-4f11-828c-ef08992a9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:24.760991 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-dcfee992-cd41-4deb-a914-c204461fb3a2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:24.761596 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-dcfee992-cd41-4deb-a914-c204461fb3a2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:24.768978 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dcfee992-cd41-4deb-a914-c204461fb3a2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:24.769672 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dcfee992-cd41-4deb-a914-c204461fb3a2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:24.770614 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dcfee992-cd41-4deb-a914-c204461fb3a2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:24.771209 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dcfee992-cd41-4deb-a914-c204461fb3a2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:24.987558 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-dcfee992-cd41-4deb-a914-c204461fb3a2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:24.990618 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e9a5ae0d-02d2-4f11-828c-ef08992a9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:25.016247 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-dcfee992-cd41-4deb-a914-c204461fb3a2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.258478 Jul 22 22:17:25.018393 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e9a5ae0d-02d2-4f11-828c-ef08992a9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:25.021504 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e9a5ae0d-02d2-4f11-828c-ef08992a9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:25.022257 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 316/614] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:24 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:25.024048 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e9a5ae0d-02d2-4f11-828c-ef08992a9c0b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1725 microversion: 2.20 time: 0.306895 Jul 22 22:17:25.024553 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 299/615] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:24 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1725 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:25.147668 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-648ddc86-7b25-4107-b0c5-491397c78ef3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:25.149327 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-648ddc86-7b25-4107-b0c5-491397c78ef3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:25.158655 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-648ddc86-7b25-4107-b0c5-491397c78ef3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:25.159505 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-648ddc86-7b25-4107-b0c5-491397c78ef3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:25.160715 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-648ddc86-7b25-4107-b0c5-491397c78ef3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:25.161410 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-648ddc86-7b25-4107-b0c5-491397c78ef3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:25.354949 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-648ddc86-7b25-4107-b0c5-491397c78ef3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:25.365153 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-648ddc86-7b25-4107-b0c5-491397c78ef3 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1518 microversion: 2.1 time: 0.224122 Jul 22 22:17:25.365548 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 317/616] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:25 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1518 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:25.537450 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-325f4d7b-6371-4e68-82b6-8cd6cb220994 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:25.538866 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-325f4d7b-6371-4e68-82b6-8cd6cb220994 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:25.548926 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-325f4d7b-6371-4e68-82b6-8cd6cb220994 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:25.549838 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-325f4d7b-6371-4e68-82b6-8cd6cb220994 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:25.551270 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-325f4d7b-6371-4e68-82b6-8cd6cb220994 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:25.551883 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-325f4d7b-6371-4e68-82b6-8cd6cb220994 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:25.597262 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-78d961ad-d9db-4da2-bdae-638821e07afc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:25.598055 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-78d961ad-d9db-4da2-bdae-638821e07afc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:25.604393 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-78d961ad-d9db-4da2-bdae-638821e07afc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:25.604965 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-78d961ad-d9db-4da2-bdae-638821e07afc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:25.605842 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-78d961ad-d9db-4da2-bdae-638821e07afc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:25.606521 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-78d961ad-d9db-4da2-bdae-638821e07afc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:25.733074 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-325f4d7b-6371-4e68-82b6-8cd6cb220994 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:25.742075 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-325f4d7b-6371-4e68-82b6-8cd6cb220994 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.209566 Jul 22 22:17:25.756401 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 300/617] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:25 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:25.808584 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-78d961ad-d9db-4da2-bdae-638821e07afc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:25.818376 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-78d961ad-d9db-4da2-bdae-638821e07afc tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1716 microversion: 2.1 time: 0.225620 Jul 22 22:17:25.819251 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 318/618] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:25 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1716 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:26.045318 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a68d0b59-d461-464c-86a1-6625966f657e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:26.045935 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a68d0b59-d461-464c-86a1-6625966f657e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:26.056418 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-54fb9719-5776-47b9-b334-c96bf5d2a8c7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:26.057279 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-54fb9719-5776-47b9-b334-c96bf5d2a8c7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:26.077359 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a68d0b59-d461-464c-86a1-6625966f657e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:26.077873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a68d0b59-d461-464c-86a1-6625966f657e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:26.079112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a68d0b59-d461-464c-86a1-6625966f657e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:26.079469 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a68d0b59-d461-464c-86a1-6625966f657e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:26.083227 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-54fb9719-5776-47b9-b334-c96bf5d2a8c7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:26.084368 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-54fb9719-5776-47b9-b334-c96bf5d2a8c7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:26.085174 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-54fb9719-5776-47b9-b334-c96bf5d2a8c7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:26.085608 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-54fb9719-5776-47b9-b334-c96bf5d2a8c7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:26.328022 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a68d0b59-d461-464c-86a1-6625966f657e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:26.338718 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a68d0b59-d461-464c-86a1-6625966f657e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:26.341895 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a68d0b59-d461-464c-86a1-6625966f657e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:26.344669 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a68d0b59-d461-464c-86a1-6625966f657e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1725 microversion: 2.20 time: 0.303068 Jul 22 22:17:26.346137 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 319/619] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:26 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1725 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:26.363084 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-54fb9719-5776-47b9-b334-c96bf5d2a8c7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:26.374223 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-54fb9719-5776-47b9-b334-c96bf5d2a8c7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.336608 Jul 22 22:17:26.375326 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-8ad2d53a-b9c2-42b4-9da4-b7b53f667212 req-2bd83c22-87a5-42f7-b557-63798f913ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230e9e16-9304-4b70-bf95-34811d9fd221", "name": "network-vif-plugged", "status": "completed", "tag": "a11e48e2-13ab-49d9-9f7b-acdce4f4cd4f"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:26.375493 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 301/620] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:26 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:26.378419 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:17:26.378419 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:17:26.386592 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4952780d-cace-4e39-aaad-85ac146d513c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:26.392986 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4952780d-cace-4e39-aaad-85ac146d513c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:26.394395 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-8ad2d53a-b9c2-42b4-9da4-b7b53f667212 req-2bd83c22-87a5-42f7-b557-63798f913ca5 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:26.395441 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-8ad2d53a-b9c2-42b4-9da4-b7b53f667212 req-2bd83c22-87a5-42f7-b557-63798f913ca5 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:26.403042 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4952780d-cace-4e39-aaad-85ac146d513c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:26.406271 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4952780d-cace-4e39-aaad-85ac146d513c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:26.407946 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4952780d-cace-4e39-aaad-85ac146d513c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:26.408724 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4952780d-cace-4e39-aaad-85ac146d513c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:26.411744 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-8ad2d53a-b9c2-42b4-9da4-b7b53f667212 req-2bd83c22-87a5-42f7-b557-63798f913ca5 service nova] Creating event network-vif-plugged:a11e48e2-13ab-49d9-9f7b-acdce4f4cd4f for instance 230e9e16-9304-4b70-bf95-34811d9fd221 on hv-cinder-80186 Jul 22 22:17:26.421067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-8ad2d53a-b9c2-42b4-9da4-b7b53f667212 req-2bd83c22-87a5-42f7-b557-63798f913ca5 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054537 Jul 22 22:17:26.422875 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 320/621] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:17:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:17:26.679469 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4952780d-cace-4e39-aaad-85ac146d513c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:26.689106 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4952780d-cace-4e39-aaad-85ac146d513c tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1518 microversion: 2.1 time: 0.307000 Jul 22 22:17:26.690125 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 302/622] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:26 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1518 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:26.774999 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-70683e94-6558-4b13-a99d-5997dfd6aa39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:26.776050 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-70683e94-6558-4b13-a99d-5997dfd6aa39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:26.784627 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70683e94-6558-4b13-a99d-5997dfd6aa39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:26.785184 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70683e94-6558-4b13-a99d-5997dfd6aa39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:26.786249 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70683e94-6558-4b13-a99d-5997dfd6aa39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:26.786684 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70683e94-6558-4b13-a99d-5997dfd6aa39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:26.845740 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-981d9913-1012-41b3-9845-4232c2b6390d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:26.847167 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-981d9913-1012-41b3-9845-4232c2b6390d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:26.867712 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-981d9913-1012-41b3-9845-4232c2b6390d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:26.867712 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-981d9913-1012-41b3-9845-4232c2b6390d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:26.877870 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-981d9913-1012-41b3-9845-4232c2b6390d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:26.878337 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-981d9913-1012-41b3-9845-4232c2b6390d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:26.981445 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-70683e94-6558-4b13-a99d-5997dfd6aa39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:26.991025 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-70683e94-6558-4b13-a99d-5997dfd6aa39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.220208 Jul 22 22:17:26.992163 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 321/623] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:26 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:27.142723 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-981d9913-1012-41b3-9845-4232c2b6390d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:27.152358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-981d9913-1012-41b3-9845-4232c2b6390d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1720 microversion: 2.1 time: 0.316201 Jul 22 22:17:27.153551 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 303/624] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:26 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1720 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:27.366971 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7b6ceeed-1891-4a14-b760-92a5ac0e4244 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:27.367575 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7b6ceeed-1891-4a14-b760-92a5ac0e4244 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:27.374803 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b6ceeed-1891-4a14-b760-92a5ac0e4244 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:27.375849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b6ceeed-1891-4a14-b760-92a5ac0e4244 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:27.376649 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b6ceeed-1891-4a14-b760-92a5ac0e4244 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:27.377071 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b6ceeed-1891-4a14-b760-92a5ac0e4244 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:27.393083 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bca59db3-19ec-404e-8102-19d4bf802565 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:27.393737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bca59db3-19ec-404e-8102-19d4bf802565 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:27.400767 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bca59db3-19ec-404e-8102-19d4bf802565 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:27.401226 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bca59db3-19ec-404e-8102-19d4bf802565 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:27.402015 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bca59db3-19ec-404e-8102-19d4bf802565 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:27.402449 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bca59db3-19ec-404e-8102-19d4bf802565 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:27.535936 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7b6ceeed-1891-4a14-b760-92a5ac0e4244 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:27.546014 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7b6ceeed-1891-4a14-b760-92a5ac0e4244 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:27.547641 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7b6ceeed-1891-4a14-b760-92a5ac0e4244 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:27.548924 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7b6ceeed-1891-4a14-b760-92a5ac0e4244 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1725 microversion: 2.20 time: 0.185694 Jul 22 22:17:27.549781 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 322/625] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:27 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:27.570894 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bca59db3-19ec-404e-8102-19d4bf802565 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:27.571429 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bca59db3-19ec-404e-8102-19d4bf802565 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.181916 Jul 22 22:17:27.572036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 304/626] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:27 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:27.706441 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7b02aa78-9266-4e20-9f82-e4a2fbcf66b4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:27.706947 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7b02aa78-9266-4e20-9f82-e4a2fbcf66b4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:27.712856 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b02aa78-9266-4e20-9f82-e4a2fbcf66b4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:27.713292 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b02aa78-9266-4e20-9f82-e4a2fbcf66b4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:27.714050 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b02aa78-9266-4e20-9f82-e4a2fbcf66b4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:27.714467 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7b02aa78-9266-4e20-9f82-e4a2fbcf66b4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:27.861366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7b02aa78-9266-4e20-9f82-e4a2fbcf66b4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:27.868783 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7b02aa78-9266-4e20-9f82-e4a2fbcf66b4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1518 microversion: 2.1 time: 0.166049 Jul 22 22:17:27.869348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 323/627] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:27 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:28.009229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-aa9c6b82-af47-4cd6-bb4e-f07f20ff40d8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:28.009850 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-aa9c6b82-af47-4cd6-bb4e-f07f20ff40d8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:28.017212 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-aa9c6b82-af47-4cd6-bb4e-f07f20ff40d8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:28.017656 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-aa9c6b82-af47-4cd6-bb4e-f07f20ff40d8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:28.018507 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-aa9c6b82-af47-4cd6-bb4e-f07f20ff40d8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:28.019045 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-aa9c6b82-af47-4cd6-bb4e-f07f20ff40d8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:28.209480 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-aa9c6b82-af47-4cd6-bb4e-f07f20ff40d8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:28.217067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-aa9c6b82-af47-4cd6-bb4e-f07f20ff40d8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.211855 Jul 22 22:17:28.217703 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 305/628] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:28 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:28.448484 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-eaced1d9-9fb6-4dc1-87f7-9ac1077f7d34 req-281e7d17-fff1-4835-9edb-9331ecbec36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e7dd91-3f55-48c9-85aa-84c2450719f2", "name": "network-vif-unplugged", "status": "completed", "tag": "e63aa00d-561e-478c-ad51-2858e1d33423"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:28.450056 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:17:28.450056 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:17:28.458709 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-eaced1d9-9fb6-4dc1-87f7-9ac1077f7d34 req-281e7d17-fff1-4835-9edb-9331ecbec36a service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:28.459149 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-eaced1d9-9fb6-4dc1-87f7-9ac1077f7d34 req-281e7d17-fff1-4835-9edb-9331ecbec36a service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:28.473200 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-eaced1d9-9fb6-4dc1-87f7-9ac1077f7d34 req-281e7d17-fff1-4835-9edb-9331ecbec36a service nova] Creating event network-vif-unplugged:e63aa00d-561e-478c-ad51-2858e1d33423 for instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 on hv-cinder-80186 Jul 22 22:17:28.479891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-eaced1d9-9fb6-4dc1-87f7-9ac1077f7d34 req-281e7d17-fff1-4835-9edb-9331ecbec36a service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034015 Jul 22 22:17:28.480228 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 324/629] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:17:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:17:28.567143 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-76fbe3ba-5f3a-4cbc-8c20-6f92ebfe0a6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:28.567783 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-76fbe3ba-5f3a-4cbc-8c20-6f92ebfe0a6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:28.573861 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-76fbe3ba-5f3a-4cbc-8c20-6f92ebfe0a6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:28.574312 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-76fbe3ba-5f3a-4cbc-8c20-6f92ebfe0a6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:28.575100 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-76fbe3ba-5f3a-4cbc-8c20-6f92ebfe0a6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:28.575540 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-76fbe3ba-5f3a-4cbc-8c20-6f92ebfe0a6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:28.593233 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0dcbf23f-13f8-490e-be54-56f791f3776f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:28.594570 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0dcbf23f-13f8-490e-be54-56f791f3776f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:28.605446 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0dcbf23f-13f8-490e-be54-56f791f3776f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:28.606020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0dcbf23f-13f8-490e-be54-56f791f3776f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:28.608686 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0dcbf23f-13f8-490e-be54-56f791f3776f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:28.609302 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0dcbf23f-13f8-490e-be54-56f791f3776f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:28.819395 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0dcbf23f-13f8-490e-be54-56f791f3776f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:28.831423 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0dcbf23f-13f8-490e-be54-56f791f3776f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.245130 Jul 22 22:17:28.838554 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 325/630] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:28 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:28.891656 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b51298c1-dd9b-48fb-8e11-a8e07de41ba6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:28.893032 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b51298c1-dd9b-48fb-8e11-a8e07de41ba6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:28.903440 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b51298c1-dd9b-48fb-8e11-a8e07de41ba6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:28.905311 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b51298c1-dd9b-48fb-8e11-a8e07de41ba6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:28.906384 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b51298c1-dd9b-48fb-8e11-a8e07de41ba6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:28.906900 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b51298c1-dd9b-48fb-8e11-a8e07de41ba6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:29.094534 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-76fbe3ba-5f3a-4cbc-8c20-6f92ebfe0a6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:29.109892 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b51298c1-dd9b-48fb-8e11-a8e07de41ba6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:29.111853 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-76fbe3ba-5f3a-4cbc-8c20-6f92ebfe0a6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:29.114002 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-76fbe3ba-5f3a-4cbc-8c20-6f92ebfe0a6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:29.117440 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-76fbe3ba-5f3a-4cbc-8c20-6f92ebfe0a6b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1725 microversion: 2.20 time: 0.553996 Jul 22 22:17:29.118714 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b51298c1-dd9b-48fb-8e11-a8e07de41ba6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1518 microversion: 2.1 time: 0.234343 Jul 22 22:17:29.118976 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 306/631] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:28 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1725 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:29.120171 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 326/632] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:28 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1518 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:29.234406 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-50384cf8-0cf0-400b-aabb-3502b8191893 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:29.234899 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-50384cf8-0cf0-400b-aabb-3502b8191893 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:29.241868 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-50384cf8-0cf0-400b-aabb-3502b8191893 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:29.242590 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-50384cf8-0cf0-400b-aabb-3502b8191893 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:29.243542 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-50384cf8-0cf0-400b-aabb-3502b8191893 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:29.244141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-50384cf8-0cf0-400b-aabb-3502b8191893 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:29.440189 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-50384cf8-0cf0-400b-aabb-3502b8191893 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:29.449011 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-50384cf8-0cf0-400b-aabb-3502b8191893 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.217891 Jul 22 22:17:29.449794 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 307/633] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:29 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:29.849112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ee1e9925-f465-421d-bb7e-df928823419e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:29.849747 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ee1e9925-f465-421d-bb7e-df928823419e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:29.858826 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ee1e9925-f465-421d-bb7e-df928823419e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:29.859343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ee1e9925-f465-421d-bb7e-df928823419e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:29.860175 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ee1e9925-f465-421d-bb7e-df928823419e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:29.860871 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ee1e9925-f465-421d-bb7e-df928823419e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:30.012597 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ee1e9925-f465-421d-bb7e-df928823419e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:30.020566 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ee1e9925-f465-421d-bb7e-df928823419e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1270 microversion: 2.1 time: 0.175289 Jul 22 22:17:30.021149 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 327/634] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:29 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:30.138069 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-39e444d5-46b9-467e-aaf4-f81a678b4052 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:30.138870 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-39e444d5-46b9-467e-aaf4-f81a678b4052 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:30.142265 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-410721f2-e62b-4186-9cc4-4111520103e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:30.145892 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-410721f2-e62b-4186-9cc4-4111520103e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:30.146677 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39e444d5-46b9-467e-aaf4-f81a678b4052 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:30.147193 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39e444d5-46b9-467e-aaf4-f81a678b4052 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:30.148049 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39e444d5-46b9-467e-aaf4-f81a678b4052 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:30.148612 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39e444d5-46b9-467e-aaf4-f81a678b4052 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:30.159787 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-410721f2-e62b-4186-9cc4-4111520103e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:30.160596 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-410721f2-e62b-4186-9cc4-4111520103e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:30.167655 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-410721f2-e62b-4186-9cc4-4111520103e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:30.168415 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-410721f2-e62b-4186-9cc4-4111520103e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:30.343523 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-39e444d5-46b9-467e-aaf4-f81a678b4052 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:30.355017 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-39e444d5-46b9-467e-aaf4-f81a678b4052 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1518 microversion: 2.1 time: 0.220557 Jul 22 22:17:30.356056 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 308/635] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:30 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1518 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:30.364649 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-410721f2-e62b-4186-9cc4-4111520103e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:30.375336 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-410721f2-e62b-4186-9cc4-4111520103e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:30.377145 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-410721f2-e62b-4186-9cc4-4111520103e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:30.378503 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-410721f2-e62b-4186-9cc4-4111520103e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1725 microversion: 2.20 time: 0.241329 Jul 22 22:17:30.383775 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 328/636] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:30 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:30.467900 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6be0da1b-cdca-4911-a14b-06209cb455fe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:30.468568 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6be0da1b-cdca-4911-a14b-06209cb455fe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:30.476229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6be0da1b-cdca-4911-a14b-06209cb455fe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:30.477039 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6be0da1b-cdca-4911-a14b-06209cb455fe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:30.478275 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6be0da1b-cdca-4911-a14b-06209cb455fe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:30.478747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6be0da1b-cdca-4911-a14b-06209cb455fe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:30.678905 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6be0da1b-cdca-4911-a14b-06209cb455fe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:30.687389 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6be0da1b-cdca-4911-a14b-06209cb455fe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.223982 Jul 22 22:17:30.687980 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 309/637] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:30 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:31.038550 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ddfa39ff-0bde-4401-a5c5-9da9bc62694d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:31.039788 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ddfa39ff-0bde-4401-a5c5-9da9bc62694d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:31.046483 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ddfa39ff-0bde-4401-a5c5-9da9bc62694d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:31.046971 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ddfa39ff-0bde-4401-a5c5-9da9bc62694d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:31.047758 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ddfa39ff-0bde-4401-a5c5-9da9bc62694d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:31.048199 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ddfa39ff-0bde-4401-a5c5-9da9bc62694d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:31.248560 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ddfa39ff-0bde-4401-a5c5-9da9bc62694d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:31.264653 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ddfa39ff-0bde-4401-a5c5-9da9bc62694d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1457 microversion: 2.1 time: 0.223936 Jul 22 22:17:31.265731 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 329/638] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:31 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1457 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:31.284593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2770f98b-0ad7-4d00-b535-d1b7acf56a5d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:31.286201 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2770f98b-0ad7-4d00-b535-d1b7acf56a5d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:31.296973 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2770f98b-0ad7-4d00-b535-d1b7acf56a5d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:31.297638 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2770f98b-0ad7-4d00-b535-d1b7acf56a5d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:31.298988 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2770f98b-0ad7-4d00-b535-d1b7acf56a5d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:31.300104 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2770f98b-0ad7-4d00-b535-d1b7acf56a5d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:31.328742 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-74f7c577-a8dc-42dc-8ef3-de3ca6c3e0e9 req-acdc4bd3-ac8d-4aa8-82f1-bba50232b02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fc8f297-285c-45e7-912f-a3f64a0d4e9b", "name": "network-vif-deleted", "tag": "254ffb11-410d-4f28-ab52-4f5ed744c1df"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:31.333920 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:17:31.333920 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:17:31.351890 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-74f7c577-a8dc-42dc-8ef3-de3ca6c3e0e9 req-acdc4bd3-ac8d-4aa8-82f1-bba50232b02e service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:31.352490 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-74f7c577-a8dc-42dc-8ef3-de3ca6c3e0e9 req-acdc4bd3-ac8d-4aa8-82f1-bba50232b02e service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:31.379102 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-74f7c577-a8dc-42dc-8ef3-de3ca6c3e0e9 req-acdc4bd3-ac8d-4aa8-82f1-bba50232b02e service nova] Creating event network-vif-deleted:254ffb11-410d-4f28-ab52-4f5ed744c1df for instance 4fc8f297-285c-45e7-912f-a3f64a0d4e9b on hv-cinder-80186 Jul 22 22:17:31.386643 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-74f7c577-a8dc-42dc-8ef3-de3ca6c3e0e9 req-acdc4bd3-ac8d-4aa8-82f1-bba50232b02e service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067094 Jul 22 22:17:31.387249 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 330/639] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:17:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:17:31.392492 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b7fc7e94-5b7d-4e67-9a96-8e4d23d897f1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:31.393503 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b7fc7e94-5b7d-4e67-9a96-8e4d23d897f1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:31.401307 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b7fc7e94-5b7d-4e67-9a96-8e4d23d897f1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:31.401962 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b7fc7e94-5b7d-4e67-9a96-8e4d23d897f1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:31.403379 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b7fc7e94-5b7d-4e67-9a96-8e4d23d897f1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:31.404232 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b7fc7e94-5b7d-4e67-9a96-8e4d23d897f1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:31.522422 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2770f98b-0ad7-4d00-b535-d1b7acf56a5d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:31.524243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b7fc7e94-5b7d-4e67-9a96-8e4d23d897f1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:31.531906 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2770f98b-0ad7-4d00-b535-d1b7acf56a5d tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1457 microversion: 2.1 time: 0.252132 Jul 22 22:17:31.535403 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b7fc7e94-5b7d-4e67-9a96-8e4d23d897f1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1307 microversion: 2.1 time: 0.146651 Jul 22 22:17:31.536413 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 331/640] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:31 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1307 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:31.542023 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b58c8952-1c42-4b53-862b-ac7cf63e2950 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:31.542976 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b58c8952-1c42-4b53-862b-ac7cf63e2950 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:31.545345 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 310/641] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:31 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1457 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:31.558918 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b58c8952-1c42-4b53-862b-ac7cf63e2950 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:31.560595 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b58c8952-1c42-4b53-862b-ac7cf63e2950 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:31.561747 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b58c8952-1c42-4b53-862b-ac7cf63e2950 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:31.562343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b58c8952-1c42-4b53-862b-ac7cf63e2950 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:31.709449 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cc56d45b-b72d-47c5-ae1f-a15b48508c8c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:31.710224 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cc56d45b-b72d-47c5-ae1f-a15b48508c8c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:31.717773 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc56d45b-b72d-47c5-ae1f-a15b48508c8c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:31.718472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc56d45b-b72d-47c5-ae1f-a15b48508c8c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:31.719381 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc56d45b-b72d-47c5-ae1f-a15b48508c8c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:31.720052 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc56d45b-b72d-47c5-ae1f-a15b48508c8c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:31.829656 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b58c8952-1c42-4b53-862b-ac7cf63e2950 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:31.843939 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b58c8952-1c42-4b53-862b-ac7cf63e2950 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:31.846542 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b58c8952-1c42-4b53-862b-ac7cf63e2950 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:31.848236 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b58c8952-1c42-4b53-862b-ac7cf63e2950 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1725 microversion: 2.20 time: 0.310291 Jul 22 22:17:31.849069 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 332/642] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:31 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:31.935061 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cc56d45b-b72d-47c5-ae1f-a15b48508c8c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:31.959637 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cc56d45b-b72d-47c5-ae1f-a15b48508c8c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.254514 Jul 22 22:17:31.976655 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 311/643] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:31 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:32.553444 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ea402e0a-8ef0-4426-a50d-2320fd2c3876 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:32.554262 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ea402e0a-8ef0-4426-a50d-2320fd2c3876 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:32.572388 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea402e0a-8ef0-4426-a50d-2320fd2c3876 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:32.573307 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea402e0a-8ef0-4426-a50d-2320fd2c3876 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:32.575164 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea402e0a-8ef0-4426-a50d-2320fd2c3876 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:32.576262 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea402e0a-8ef0-4426-a50d-2320fd2c3876 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:32.638393 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea402e0a-8ef0-4426-a50d-2320fd2c3876 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:32.639354 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea402e0a-8ef0-4426-a50d-2320fd2c3876 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:32.639810 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-ea402e0a-8ef0-4426-a50d-2320fd2c3876 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lazy-loading 'fault' on Instance uuid 4fc8f297-285c-45e7-912f-a3f64a0d4e9b {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:17:32.765100 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ea402e0a-8ef0-4426-a50d-2320fd2c3876 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:32.777791 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ea402e0a-8ef0-4426-a50d-2320fd2c3876 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 200 len: 1312 microversion: 2.1 time: 0.227935 Jul 22 22:17:32.778886 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 333/644] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:32 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:32.869870 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c2718530-b2aa-4927-876d-0899bdd9db9d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:32.870556 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c2718530-b2aa-4927-876d-0899bdd9db9d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:32.878042 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2718530-b2aa-4927-876d-0899bdd9db9d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:32.878495 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2718530-b2aa-4927-876d-0899bdd9db9d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:32.879306 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2718530-b2aa-4927-876d-0899bdd9db9d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:32.879724 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c2718530-b2aa-4927-876d-0899bdd9db9d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:32.989346 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-17edbb92-6482-4a81-9def-f00dce694b69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:32.990471 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-17edbb92-6482-4a81-9def-f00dce694b69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:33.001490 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-17edbb92-6482-4a81-9def-f00dce694b69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.002273 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-17edbb92-6482-4a81-9def-f00dce694b69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.003697 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-17edbb92-6482-4a81-9def-f00dce694b69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.004642 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-17edbb92-6482-4a81-9def-f00dce694b69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.073738 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c2718530-b2aa-4927-876d-0899bdd9db9d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:33.084653 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c2718530-b2aa-4927-876d-0899bdd9db9d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:33.086298 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c2718530-b2aa-4927-876d-0899bdd9db9d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:33.087434 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c2718530-b2aa-4927-876d-0899bdd9db9d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1728 microversion: 2.20 time: 0.222267 Jul 22 22:17:33.088006 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 312/645] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:32 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:33.109074 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b3a8456d-c315-4c72-9395-1aea83567720 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82ca9a69-c7bc-463d-bee5-7c434ad20a8f"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:33.110220 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b3a8456d-c315-4c72-9395-1aea83567720 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:33.116551 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3a8456d-c315-4c72-9395-1aea83567720 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.117166 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3a8456d-c315-4c72-9395-1aea83567720 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.117841 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3a8456d-c315-4c72-9395-1aea83567720 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.118277 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3a8456d-c315-4c72-9395-1aea83567720 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.273420 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-17edbb92-6482-4a81-9def-f00dce694b69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:33.287454 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-17edbb92-6482-4a81-9def-f00dce694b69 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.306041 Jul 22 22:17:33.288101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 334/646] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:32 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:33.566142 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b3a8456d-c315-4c72-9395-1aea83567720 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.461840 Jul 22 22:17:33.566996 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 313/647] 10.222.0.110 () {62 vars in 1369 bytes} [Thu Jul 22 22:17:33 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/os-volume_attachments => generated 188 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:17:33.656386 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c58eccb5-0f89-4b8b-aa07-28425ba9684e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:33.657198 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c58eccb5-0f89-4b8b-aa07-28425ba9684e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:33.663072 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c58eccb5-0f89-4b8b-aa07-28425ba9684e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.663518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c58eccb5-0f89-4b8b-aa07-28425ba9684e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.664315 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c58eccb5-0f89-4b8b-aa07-28425ba9684e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.664760 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c58eccb5-0f89-4b8b-aa07-28425ba9684e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.774042 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c58eccb5-0f89-4b8b-aa07-28425ba9684e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action" status: 202 len: 0 microversion: 2.20 time: 0.123033 Jul 22 22:17:33.778321 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 335/648] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:17:33 2021] POST /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:17:33.787398 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-850f2532-0b7c-4555-9bf5-21d95e23391d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:33.788459 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-850f2532-0b7c-4555-9bf5-21d95e23391d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:33.799935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-850f2532-0b7c-4555-9bf5-21d95e23391d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.801207 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-850f2532-0b7c-4555-9bf5-21d95e23391d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.802564 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-850f2532-0b7c-4555-9bf5-21d95e23391d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.803560 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-850f2532-0b7c-4555-9bf5-21d95e23391d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.805603 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f38ff5a4-296f-41c2-ae4b-e5c1a01d331e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:33.806708 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f38ff5a4-296f-41c2-ae4b-e5c1a01d331e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4fc8f297-285c-45e7-912f-a3f64a0d4e9b] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:33.821815 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f38ff5a4-296f-41c2-ae4b-e5c1a01d331e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.822464 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f38ff5a4-296f-41c2-ae4b-e5c1a01d331e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.824517 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f38ff5a4-296f-41c2-ae4b-e5c1a01d331e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.826601 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f38ff5a4-296f-41c2-ae4b-e5c1a01d331e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.848136 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-f38ff5a4-296f-41c2-ae4b-e5c1a01d331e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] HTTP exception thrown: Instance 4fc8f297-285c-45e7-912f-a3f64a0d4e9b could not be found. Jul 22 22:17:33.849986 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f38ff5a4-296f-41c2-ae4b-e5c1a01d331e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Returning 404 to user: Instance 4fc8f297-285c-45e7-912f-a3f64a0d4e9b could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:17:33.851332 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f38ff5a4-296f-41c2-ae4b-e5c1a01d331e tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b" status: 404 len: 111 microversion: 2.1 time: 0.051918 Jul 22 22:17:33.852859 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 336/649] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:33 2021] GET /compute/v2.1/servers/4fc8f297-285c-45e7-912f-a3f64a0d4e9b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:17:33.863707 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-245a866b-9ad1-4756-ae72-e7660ea65faf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:33.864761 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-245a866b-9ad1-4756-ae72-e7660ea65faf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:33.872071 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-245a866b-9ad1-4756-ae72-e7660ea65faf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.873548 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-245a866b-9ad1-4756-ae72-e7660ea65faf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.874866 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-245a866b-9ad1-4756-ae72-e7660ea65faf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:33.875578 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-245a866b-9ad1-4756-ae72-e7660ea65faf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:33.907307 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-245a866b-9ad1-4756-ae72-e7660ea65faf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Going to try to terminate instance {{(pid=107499) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:17:34.054610 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-245a866b-9ad1-4756-ae72-e7660ea65faf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "DELETE /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 204 len: 0 microversion: 2.1 time: 0.194593 Jul 22 22:17:34.055864 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 337/650] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:17:33 2021] DELETE /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:17:34.072512 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bb1dc0be-166c-4c57-82be-cb82b2371ac6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:34.076235 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-bb1dc0be-166c-4c57-82be-cb82b2371ac6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:34.086814 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bb1dc0be-166c-4c57-82be-cb82b2371ac6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:34.087618 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bb1dc0be-166c-4c57-82be-cb82b2371ac6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:34.089089 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bb1dc0be-166c-4c57-82be-cb82b2371ac6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:34.089848 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bb1dc0be-166c-4c57-82be-cb82b2371ac6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:34.118096 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-850f2532-0b7c-4555-9bf5-21d95e23391d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:34.131542 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-850f2532-0b7c-4555-9bf5-21d95e23391d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:34.134067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-850f2532-0b7c-4555-9bf5-21d95e23391d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:34.135835 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-850f2532-0b7c-4555-9bf5-21d95e23391d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1754 microversion: 2.20 time: 0.355575 Jul 22 22:17:34.137088 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 314/651] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:33 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1754 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:34.319013 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8b2455a2-8600-4f54-9b29-1806906c411e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:34.320490 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8b2455a2-8600-4f54-9b29-1806906c411e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:34.333468 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b2455a2-8600-4f54-9b29-1806906c411e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:34.334013 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b2455a2-8600-4f54-9b29-1806906c411e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:34.335018 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b2455a2-8600-4f54-9b29-1806906c411e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:34.335559 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b2455a2-8600-4f54-9b29-1806906c411e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:34.499843 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-bb1dc0be-166c-4c57-82be-cb82b2371ac6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:34.515965 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-bb1dc0be-166c-4c57-82be-cb82b2371ac6 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1516 microversion: 2.1 time: 0.453631 Jul 22 22:17:34.517401 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 338/652] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:34 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1516 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:34.532103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8b2455a2-8600-4f54-9b29-1806906c411e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:34.547759 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8b2455a2-8600-4f54-9b29-1806906c411e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.237631 Jul 22 22:17:34.549020 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 315/653] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:34 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:34.823940 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-dd9ee3b6-0a28-4f3b-8441-4abd00f9b388 req-a3fc2c21-0047-4b87-81f2-94cdb16697e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "230e9e16-9304-4b70-bf95-34811d9fd221", "tag": "a11e48e2-13ab-49d9-9f7b-acdce4f4cd4f"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:34.826233 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:17:34.826233 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:17:34.843049 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-dd9ee3b6-0a28-4f3b-8441-4abd00f9b388 req-a3fc2c21-0047-4b87-81f2-94cdb16697e7 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:34.843953 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-dd9ee3b6-0a28-4f3b-8441-4abd00f9b388 req-a3fc2c21-0047-4b87-81f2-94cdb16697e7 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:34.861379 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-dd9ee3b6-0a28-4f3b-8441-4abd00f9b388 req-a3fc2c21-0047-4b87-81f2-94cdb16697e7 service nova] Creating event network-changed:a11e48e2-13ab-49d9-9f7b-acdce4f4cd4f for instance 230e9e16-9304-4b70-bf95-34811d9fd221 on hv-cinder-80186 Jul 22 22:17:34.867556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-dd9ee3b6-0a28-4f3b-8441-4abd00f9b388 req-a3fc2c21-0047-4b87-81f2-94cdb16697e7 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047810 Jul 22 22:17:34.868866 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 339/654] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:17:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:17:35.160009 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ae3770fd-80da-468b-b340-64460253e846 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:35.160718 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ae3770fd-80da-468b-b340-64460253e846 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:35.169847 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae3770fd-80da-468b-b340-64460253e846 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:35.170389 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae3770fd-80da-468b-b340-64460253e846 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:35.171317 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae3770fd-80da-468b-b340-64460253e846 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:35.171836 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ae3770fd-80da-468b-b340-64460253e846 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:35.504596 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ae3770fd-80da-468b-b340-64460253e846 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:35.520327 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ae3770fd-80da-468b-b340-64460253e846 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:35.522059 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ae3770fd-80da-468b-b340-64460253e846 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:35.523330 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ae3770fd-80da-468b-b340-64460253e846 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1754 microversion: 2.20 time: 0.367641 Jul 22 22:17:35.523996 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 316/655] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:35 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1754 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:35.536265 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-debe644a-29c7-485b-8f1c-ecb3e1a55ad7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:35.537122 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-debe644a-29c7-485b-8f1c-ecb3e1a55ad7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:35.544793 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-debe644a-29c7-485b-8f1c-ecb3e1a55ad7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:35.545561 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-debe644a-29c7-485b-8f1c-ecb3e1a55ad7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:35.546535 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-debe644a-29c7-485b-8f1c-ecb3e1a55ad7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:35.547052 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-debe644a-29c7-485b-8f1c-ecb3e1a55ad7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:35.573430 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fc173499-b955-46b4-8d4c-8c32efb47e82 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:35.574614 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fc173499-b955-46b4-8d4c-8c32efb47e82 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:35.585981 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc173499-b955-46b4-8d4c-8c32efb47e82 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:35.592541 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc173499-b955-46b4-8d4c-8c32efb47e82 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:35.598778 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc173499-b955-46b4-8d4c-8c32efb47e82 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:35.601216 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fc173499-b955-46b4-8d4c-8c32efb47e82 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:35.740583 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-debe644a-29c7-485b-8f1c-ecb3e1a55ad7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:35.749014 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-debe644a-29c7-485b-8f1c-ecb3e1a55ad7 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1516 microversion: 2.1 time: 0.217574 Jul 22 22:17:35.749899 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 340/656] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:35 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:35.909692 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fc173499-b955-46b4-8d4c-8c32efb47e82 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:35.919740 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fc173499-b955-46b4-8d4c-8c32efb47e82 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.352519 Jul 22 22:17:35.920839 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 317/657] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:35 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:36.542476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ced909c6-9ad4-4da9-bf03-7fac27be0635 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:36.543088 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ced909c6-9ad4-4da9-bf03-7fac27be0635 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:36.550241 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ced909c6-9ad4-4da9-bf03-7fac27be0635 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:36.550693 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ced909c6-9ad4-4da9-bf03-7fac27be0635 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:36.551484 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ced909c6-9ad4-4da9-bf03-7fac27be0635 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:36.551922 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ced909c6-9ad4-4da9-bf03-7fac27be0635 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:36.770365 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3f0fc966-9713-4f4a-b33e-059347146ffd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:36.771701 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3f0fc966-9713-4f4a-b33e-059347146ffd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:36.782472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3f0fc966-9713-4f4a-b33e-059347146ffd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:36.783166 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3f0fc966-9713-4f4a-b33e-059347146ffd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:36.784370 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3f0fc966-9713-4f4a-b33e-059347146ffd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:36.784849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ced909c6-9ad4-4da9-bf03-7fac27be0635 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:36.785071 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3f0fc966-9713-4f4a-b33e-059347146ffd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:36.799157 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ced909c6-9ad4-4da9-bf03-7fac27be0635 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:36.802045 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ced909c6-9ad4-4da9-bf03-7fac27be0635 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:36.804210 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ced909c6-9ad4-4da9-bf03-7fac27be0635 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1756 microversion: 2.20 time: 0.265312 Jul 22 22:17:36.805348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 341/658] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:36 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1756 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:36.937433 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-af4b6f16-88e1-42c6-8c72-2900a7232b4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:36.938045 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-af4b6f16-88e1-42c6-8c72-2900a7232b4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:36.944406 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-af4b6f16-88e1-42c6-8c72-2900a7232b4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:36.944858 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-af4b6f16-88e1-42c6-8c72-2900a7232b4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:36.945659 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-af4b6f16-88e1-42c6-8c72-2900a7232b4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:36.946390 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-af4b6f16-88e1-42c6-8c72-2900a7232b4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:36.985930 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3f0fc966-9713-4f4a-b33e-059347146ffd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:36.994322 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3f0fc966-9713-4f4a-b33e-059347146ffd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1516 microversion: 2.1 time: 0.231480 Jul 22 22:17:36.995166 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 318/659] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:36 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1516 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:37.119411 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-af4b6f16-88e1-42c6-8c72-2900a7232b4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:37.128406 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-af4b6f16-88e1-42c6-8c72-2900a7232b4e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.195147 Jul 22 22:17:37.128998 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 342/660] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:36 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:37.836237 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fbe2c661-a02d-4ec6-a8a0-4d3b50ed0e87 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:37.836886 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fbe2c661-a02d-4ec6-a8a0-4d3b50ed0e87 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:37.843444 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fbe2c661-a02d-4ec6-a8a0-4d3b50ed0e87 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:37.843886 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fbe2c661-a02d-4ec6-a8a0-4d3b50ed0e87 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:37.844667 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fbe2c661-a02d-4ec6-a8a0-4d3b50ed0e87 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:37.845099 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fbe2c661-a02d-4ec6-a8a0-4d3b50ed0e87 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:38.017697 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-349c5e8d-774c-49ea-965d-b23fc4fa686d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:38.018451 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-349c5e8d-774c-49ea-965d-b23fc4fa686d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:38.026617 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-349c5e8d-774c-49ea-965d-b23fc4fa686d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:38.027438 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-349c5e8d-774c-49ea-965d-b23fc4fa686d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:38.029159 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-349c5e8d-774c-49ea-965d-b23fc4fa686d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:38.029873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-349c5e8d-774c-49ea-965d-b23fc4fa686d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:38.132105 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-349c5e8d-774c-49ea-965d-b23fc4fa686d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:38.152374 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-349c5e8d-774c-49ea-965d-b23fc4fa686d tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 200 len: 1474 microversion: 2.1 time: 0.136251 Jul 22 22:17:38.162867 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 343/661] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:38 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 1474 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:38.168071 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-a812157d-dc42-45bb-8703-eb89114acd51 req-dbd56bad-e940-4e30-b83d-5ac69c532943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "010bd492-cc37-4210-b96a-17ed70f671f4", "name": "network-vif-deleted", "tag": "978e58db-f735-4744-ba09-2529a5fc8452"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:38.171344 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:17:38.171344 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:17:38.179462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fbe2c661-a02d-4ec6-a8a0-4d3b50ed0e87 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:38.181052 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-a812157d-dc42-45bb-8703-eb89114acd51 req-dbd56bad-e940-4e30-b83d-5ac69c532943 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:38.182211 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-a812157d-dc42-45bb-8703-eb89114acd51 req-dbd56bad-e940-4e30-b83d-5ac69c532943 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:38.198649 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fbe2c661-a02d-4ec6-a8a0-4d3b50ed0e87 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:38.205981 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fbe2c661-a02d-4ec6-a8a0-4d3b50ed0e87 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:38.206971 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fbe2c661-a02d-4ec6-a8a0-4d3b50ed0e87 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.374467 Jul 22 22:17:38.209985 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-a812157d-dc42-45bb-8703-eb89114acd51 req-dbd56bad-e940-4e30-b83d-5ac69c532943 service nova] Creating event network-vif-deleted:978e58db-f735-4744-ba09-2529a5fc8452 for instance 010bd492-cc37-4210-b96a-17ed70f671f4 on hv-cinder-80186 Jul 22 22:17:38.213178 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 319/662] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:37 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:38.224992 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-a812157d-dc42-45bb-8703-eb89114acd51 req-dbd56bad-e940-4e30-b83d-5ac69c532943 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059845 Jul 22 22:17:38.226076 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 344/663] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:17:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:17:38.228624 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-255069ce-6bcf-4175-b902-107288a2c29f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:38.229630 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-255069ce-6bcf-4175-b902-107288a2c29f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:38.241415 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-255069ce-6bcf-4175-b902-107288a2c29f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:38.242570 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-255069ce-6bcf-4175-b902-107288a2c29f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:38.245030 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-255069ce-6bcf-4175-b902-107288a2c29f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:38.246252 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-255069ce-6bcf-4175-b902-107288a2c29f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:38.443034 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-255069ce-6bcf-4175-b902-107288a2c29f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:38.453054 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-255069ce-6bcf-4175-b902-107288a2c29f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.238437 Jul 22 22:17:38.454117 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 320/664] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:38 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:39.171282 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5f79a312-512b-407e-9a2a-b6b2608100ba tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:39.171919 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5f79a312-512b-407e-9a2a-b6b2608100ba tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 010bd492-cc37-4210-b96a-17ed70f671f4] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:39.180925 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5f79a312-512b-407e-9a2a-b6b2608100ba tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:39.181506 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5f79a312-512b-407e-9a2a-b6b2608100ba tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:39.182481 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5f79a312-512b-407e-9a2a-b6b2608100ba tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:39.182958 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5f79a312-512b-407e-9a2a-b6b2608100ba tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:39.201532 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-5f79a312-512b-407e-9a2a-b6b2608100ba tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] HTTP exception thrown: Instance 010bd492-cc37-4210-b96a-17ed70f671f4 could not be found. Jul 22 22:17:39.202325 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5f79a312-512b-407e-9a2a-b6b2608100ba tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Returning 404 to user: Instance 010bd492-cc37-4210-b96a-17ed70f671f4 could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:17:39.203176 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5f79a312-512b-407e-9a2a-b6b2608100ba tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4" status: 404 len: 111 microversion: 2.1 time: 0.036510 Jul 22 22:17:39.203745 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 345/665] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:39 2021] GET /compute/v2.1/servers/010bd492-cc37-4210-b96a-17ed70f671f4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:17:39.233023 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2844747d-8064-4144-a069-6d5cdea86e70 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:39.234008 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2844747d-8064-4144-a069-6d5cdea86e70 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:39.240905 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2844747d-8064-4144-a069-6d5cdea86e70 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:39.241360 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2844747d-8064-4144-a069-6d5cdea86e70 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:39.242166 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2844747d-8064-4144-a069-6d5cdea86e70 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:39.242608 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2844747d-8064-4144-a069-6d5cdea86e70 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:39.448967 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2844747d-8064-4144-a069-6d5cdea86e70 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:39.463312 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2844747d-8064-4144-a069-6d5cdea86e70 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:39.466851 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2844747d-8064-4144-a069-6d5cdea86e70 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:39.468818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2844747d-8064-4144-a069-6d5cdea86e70 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.241079 Jul 22 22:17:39.469758 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 321/666] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:39 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:39.479118 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-da03f81e-a616-4708-b250-5548e11fc90c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:39.480408 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-da03f81e-a616-4708-b250-5548e11fc90c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:39.486776 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-da03f81e-a616-4708-b250-5548e11fc90c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:39.487296 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-da03f81e-a616-4708-b250-5548e11fc90c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:39.488075 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-da03f81e-a616-4708-b250-5548e11fc90c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:39.488541 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-da03f81e-a616-4708-b250-5548e11fc90c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:39.646945 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-da03f81e-a616-4708-b250-5548e11fc90c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:39.655690 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-da03f81e-a616-4708-b250-5548e11fc90c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.180359 Jul 22 22:17:39.656259 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 346/667] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:39 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:40.390761 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-abdb2782-d0ea-4b67-a76b-fa75d8a27644 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:40.391335 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-abdb2782-d0ea-4b67-a76b-fa75d8a27644 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:40.398351 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-abdb2782-d0ea-4b67-a76b-fa75d8a27644 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:40.398865 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-abdb2782-d0ea-4b67-a76b-fa75d8a27644 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:40.399671 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-abdb2782-d0ea-4b67-a76b-fa75d8a27644 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:40.400108 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-abdb2782-d0ea-4b67-a76b-fa75d8a27644 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:40.427969 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-abdb2782-d0ea-4b67-a76b-fa75d8a27644 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:17:40.498810 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f18380d2-2fd4-4933-9ad6-e54bb3e9357d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:40.499944 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f18380d2-2fd4-4933-9ad6-e54bb3e9357d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:40.519048 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f18380d2-2fd4-4933-9ad6-e54bb3e9357d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:40.520031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f18380d2-2fd4-4933-9ad6-e54bb3e9357d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:40.521904 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f18380d2-2fd4-4933-9ad6-e54bb3e9357d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:40.523049 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f18380d2-2fd4-4933-9ad6-e54bb3e9357d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:40.541376 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-abdb2782-d0ea-4b67-a76b-fa75d8a27644 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "DELETE /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 204 len: 0 microversion: 2.1 time: 0.154045 Jul 22 22:17:40.541978 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 322/668] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:17:40 2021] DELETE /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:17:40.552872 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3acc5d7a-9d81-4555-943c-eb7803cddce9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:40.554005 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3acc5d7a-9d81-4555-943c-eb7803cddce9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:40.564901 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3acc5d7a-9d81-4555-943c-eb7803cddce9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:40.566014 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3acc5d7a-9d81-4555-943c-eb7803cddce9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:40.567815 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3acc5d7a-9d81-4555-943c-eb7803cddce9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:40.568746 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3acc5d7a-9d81-4555-943c-eb7803cddce9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:40.754101 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3acc5d7a-9d81-4555-943c-eb7803cddce9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:40.763751 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3acc5d7a-9d81-4555-943c-eb7803cddce9 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.215467 Jul 22 22:17:40.764124 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f18380d2-2fd4-4933-9ad6-e54bb3e9357d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:40.765068 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 323/669] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:40 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:40.775143 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-847baa85-3d07-4167-9974-b1a7b76edebc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:40.775912 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-847baa85-3d07-4167-9974-b1a7b76edebc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:40.784835 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-847baa85-3d07-4167-9974-b1a7b76edebc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:40.785584 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f18380d2-2fd4-4933-9ad6-e54bb3e9357d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:40.786050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-847baa85-3d07-4167-9974-b1a7b76edebc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:40.786888 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-847baa85-3d07-4167-9974-b1a7b76edebc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:40.787211 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f18380d2-2fd4-4933-9ad6-e54bb3e9357d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:40.787346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-847baa85-3d07-4167-9974-b1a7b76edebc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:40.788444 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f18380d2-2fd4-4933-9ad6-e54bb3e9357d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.298293 Jul 22 22:17:40.789503 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 347/670] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:40 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:41.024842 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-847baa85-3d07-4167-9974-b1a7b76edebc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:41.041661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-847baa85-3d07-4167-9974-b1a7b76edebc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.268538 Jul 22 22:17:41.041661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 324/671] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:40 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:41.162472 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-77c4fb9b-98ef-4cdb-81a7-70aeea1ee963 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:17:41.163773 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-77c4fb9b-98ef-4cdb-81a7-70aeea1ee963 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:41.170422 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-77c4fb9b-98ef-4cdb-81a7-70aeea1ee963 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:41.170861 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-77c4fb9b-98ef-4cdb-81a7-70aeea1ee963 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:41.171650 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-77c4fb9b-98ef-4cdb-81a7-70aeea1ee963 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:41.172077 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-77c4fb9b-98ef-4cdb-81a7-70aeea1ee963 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:41.282540 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-77c4fb9b-98ef-4cdb-81a7-70aeea1ee963 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "POST /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/action" status: 202 len: 0 microversion: 2.1 time: 0.123682 Jul 22 22:17:41.286469 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 348/672] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:17:41 2021] POST /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:17:41.291471 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7c13cdac-08c7-4ca3-ac07-b332b47e22e8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:41.292083 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7c13cdac-08c7-4ca3-ac07-b332b47e22e8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:41.299180 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7c13cdac-08c7-4ca3-ac07-b332b47e22e8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:41.299709 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7c13cdac-08c7-4ca3-ac07-b332b47e22e8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:41.300710 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7c13cdac-08c7-4ca3-ac07-b332b47e22e8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:41.301200 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7c13cdac-08c7-4ca3-ac07-b332b47e22e8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:41.474131 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7c13cdac-08c7-4ca3-ac07-b332b47e22e8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:41.486759 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7c13cdac-08c7-4ca3-ac07-b332b47e22e8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.198885 Jul 22 22:17:41.487328 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 325/673] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:41 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:41.782800 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-191dc4d4-1e2d-4f33-900b-3ce69fe24e33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:41.783551 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-191dc4d4-1e2d-4f33-900b-3ce69fe24e33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:41.790304 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-191dc4d4-1e2d-4f33-900b-3ce69fe24e33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:41.790748 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-191dc4d4-1e2d-4f33-900b-3ce69fe24e33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:41.791542 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-191dc4d4-1e2d-4f33-900b-3ce69fe24e33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:41.791977 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-191dc4d4-1e2d-4f33-900b-3ce69fe24e33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:41.814019 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-46586ebc-82a9-49b2-9509-3ef6388e0af8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:41.814745 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-46586ebc-82a9-49b2-9509-3ef6388e0af8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:41.822473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-46586ebc-82a9-49b2-9509-3ef6388e0af8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:41.822936 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-46586ebc-82a9-49b2-9509-3ef6388e0af8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:41.824693 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-46586ebc-82a9-49b2-9509-3ef6388e0af8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:41.825989 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-46586ebc-82a9-49b2-9509-3ef6388e0af8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:42.013396 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-191dc4d4-1e2d-4f33-900b-3ce69fe24e33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:42.027529 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-191dc4d4-1e2d-4f33-900b-3ce69fe24e33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.249417 Jul 22 22:17:42.030040 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 349/674] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:41 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:42.036175 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-46586ebc-82a9-49b2-9509-3ef6388e0af8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:42.057340 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-46586ebc-82a9-49b2-9509-3ef6388e0af8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:42.058884 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-46586ebc-82a9-49b2-9509-3ef6388e0af8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:42.060430 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-46586ebc-82a9-49b2-9509-3ef6388e0af8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.251607 Jul 22 22:17:42.061440 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 326/675] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:41 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:42.069506 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-977bd489-5332-4d4d-9aae-faecf26b92e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:42.071137 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-977bd489-5332-4d4d-9aae-faecf26b92e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:42.077674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-977bd489-5332-4d4d-9aae-faecf26b92e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:42.078216 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-977bd489-5332-4d4d-9aae-faecf26b92e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:42.079087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-977bd489-5332-4d4d-9aae-faecf26b92e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:42.079524 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-977bd489-5332-4d4d-9aae-faecf26b92e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:42.266256 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-977bd489-5332-4d4d-9aae-faecf26b92e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:42.274539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-977bd489-5332-4d4d-9aae-faecf26b92e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.208690 Jul 22 22:17:42.275140 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 350/676] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:42 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:42.506057 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c4ed6609-b19f-4b25-af80-8d8754aafdd0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:42.506898 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c4ed6609-b19f-4b25-af80-8d8754aafdd0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:42.514709 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c4ed6609-b19f-4b25-af80-8d8754aafdd0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:42.515262 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c4ed6609-b19f-4b25-af80-8d8754aafdd0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:42.516030 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c4ed6609-b19f-4b25-af80-8d8754aafdd0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:42.516517 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c4ed6609-b19f-4b25-af80-8d8754aafdd0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:42.700951 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c4ed6609-b19f-4b25-af80-8d8754aafdd0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:42.715186 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c4ed6609-b19f-4b25-af80-8d8754aafdd0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.213007 Jul 22 22:17:42.718627 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 327/677] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:42 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:43.051983 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-650c4b50-cad9-49be-9ffb-62bb68c35e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:43.052921 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-650c4b50-cad9-49be-9ffb-62bb68c35e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:43.062370 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-650c4b50-cad9-49be-9ffb-62bb68c35e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:43.062640 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-650c4b50-cad9-49be-9ffb-62bb68c35e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:43.063323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-650c4b50-cad9-49be-9ffb-62bb68c35e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:43.063759 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-650c4b50-cad9-49be-9ffb-62bb68c35e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:43.089534 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6e470bc1-ad6f-4209-acd0-119706864f1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:43.090210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6e470bc1-ad6f-4209-acd0-119706864f1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:43.097855 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6e470bc1-ad6f-4209-acd0-119706864f1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:43.098311 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6e470bc1-ad6f-4209-acd0-119706864f1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:43.099869 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6e470bc1-ad6f-4209-acd0-119706864f1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:43.099869 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6e470bc1-ad6f-4209-acd0-119706864f1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:43.298329 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-650c4b50-cad9-49be-9ffb-62bb68c35e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:43.309027 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-650c4b50-cad9-49be-9ffb-62bb68c35e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.261680 Jul 22 22:17:43.310247 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 351/678] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:43 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:43.317261 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-67e741da-9f8b-4074-86ab-e9e4511ce0d3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:43.317886 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-67e741da-9f8b-4074-86ab-e9e4511ce0d3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:43.331674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67e741da-9f8b-4074-86ab-e9e4511ce0d3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:43.332072 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6e470bc1-ad6f-4209-acd0-119706864f1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:43.332519 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67e741da-9f8b-4074-86ab-e9e4511ce0d3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:43.334020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67e741da-9f8b-4074-86ab-e9e4511ce0d3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:43.334020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67e741da-9f8b-4074-86ab-e9e4511ce0d3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:43.344106 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6e470bc1-ad6f-4209-acd0-119706864f1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:43.347006 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6e470bc1-ad6f-4209-acd0-119706864f1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:43.349324 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6e470bc1-ad6f-4209-acd0-119706864f1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.265598 Jul 22 22:17:43.350673 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 328/679] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:43 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:43.534136 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-67e741da-9f8b-4074-86ab-e9e4511ce0d3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:43.543999 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-67e741da-9f8b-4074-86ab-e9e4511ce0d3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.231287 Jul 22 22:17:43.545106 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 352/680] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:43 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:43.736761 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8b989cf1-6ceb-4bdc-afd3-e1cdb6a72020 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:43.737518 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8b989cf1-6ceb-4bdc-afd3-e1cdb6a72020 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:43.743339 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b989cf1-6ceb-4bdc-afd3-e1cdb6a72020 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:43.743784 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b989cf1-6ceb-4bdc-afd3-e1cdb6a72020 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:43.744601 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b989cf1-6ceb-4bdc-afd3-e1cdb6a72020 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:43.745039 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b989cf1-6ceb-4bdc-afd3-e1cdb6a72020 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:43.934890 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8b989cf1-6ceb-4bdc-afd3-e1cdb6a72020 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:43.943838 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8b989cf1-6ceb-4bdc-afd3-e1cdb6a72020 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.210757 Jul 22 22:17:43.944545 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 329/681] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:43 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:44.333694 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e99967b3-fd27-45d4-9ba2-4769a0fc49e4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:44.334301 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e99967b3-fd27-45d4-9ba2-4769a0fc49e4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:44.340595 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e99967b3-fd27-45d4-9ba2-4769a0fc49e4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:44.341149 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e99967b3-fd27-45d4-9ba2-4769a0fc49e4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:44.342103 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e99967b3-fd27-45d4-9ba2-4769a0fc49e4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:44.342543 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e99967b3-fd27-45d4-9ba2-4769a0fc49e4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:44.370089 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-425d764d-5132-4218-ae37-792081778079 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:44.370705 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-425d764d-5132-4218-ae37-792081778079 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:44.378903 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-425d764d-5132-4218-ae37-792081778079 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:44.386031 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-425d764d-5132-4218-ae37-792081778079 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:44.386880 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-425d764d-5132-4218-ae37-792081778079 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:44.387360 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-425d764d-5132-4218-ae37-792081778079 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:44.499297 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e99967b3-fd27-45d4-9ba2-4769a0fc49e4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:44.513615 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e99967b3-fd27-45d4-9ba2-4769a0fc49e4 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.183144 Jul 22 22:17:44.514966 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 353/682] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:44 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:44.546069 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-425d764d-5132-4218-ae37-792081778079 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:44.555249 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-425d764d-5132-4218-ae37-792081778079 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:44.556767 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-425d764d-5132-4218-ae37-792081778079 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:44.567203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-425d764d-5132-4218-ae37-792081778079 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.192058 Jul 22 22:17:44.567203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 330/683] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:44 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:44.567533 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8313b4bd-0240-4276-a0de-81a9431486e6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:44.567533 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8313b4bd-0240-4276-a0de-81a9431486e6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:44.571504 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8313b4bd-0240-4276-a0de-81a9431486e6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:44.571933 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8313b4bd-0240-4276-a0de-81a9431486e6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:44.572739 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8313b4bd-0240-4276-a0de-81a9431486e6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:44.573168 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8313b4bd-0240-4276-a0de-81a9431486e6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:44.744800 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8313b4bd-0240-4276-a0de-81a9431486e6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:44.755692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8313b4bd-0240-4276-a0de-81a9431486e6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.195030 Jul 22 22:17:44.756441 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 354/684] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:44 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:44.962167 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9e58706d-1d4c-4d30-870a-25f563943105 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:44.962793 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9e58706d-1d4c-4d30-870a-25f563943105 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:44.969661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9e58706d-1d4c-4d30-870a-25f563943105 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:44.970106 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9e58706d-1d4c-4d30-870a-25f563943105 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:44.971159 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9e58706d-1d4c-4d30-870a-25f563943105 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:44.971624 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9e58706d-1d4c-4d30-870a-25f563943105 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:45.166575 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9e58706d-1d4c-4d30-870a-25f563943105 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:45.177162 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9e58706d-1d4c-4d30-870a-25f563943105 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.218533 Jul 22 22:17:45.177749 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 331/685] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:44 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:45.531961 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-439038d1-1ee7-42ee-9b5e-7c2a6c24bf09 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:45.532679 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-439038d1-1ee7-42ee-9b5e-7c2a6c24bf09 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:45.540304 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-439038d1-1ee7-42ee-9b5e-7c2a6c24bf09 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:45.540757 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-439038d1-1ee7-42ee-9b5e-7c2a6c24bf09 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:45.541561 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-439038d1-1ee7-42ee-9b5e-7c2a6c24bf09 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:45.542029 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-439038d1-1ee7-42ee-9b5e-7c2a6c24bf09 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:45.579603 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0151ddb0-b487-4dc6-a241-601f0c3834b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:45.580228 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0151ddb0-b487-4dc6-a241-601f0c3834b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:45.586636 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0151ddb0-b487-4dc6-a241-601f0c3834b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:45.587100 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0151ddb0-b487-4dc6-a241-601f0c3834b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:45.587906 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0151ddb0-b487-4dc6-a241-601f0c3834b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:45.588381 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0151ddb0-b487-4dc6-a241-601f0c3834b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:45.756195 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-439038d1-1ee7-42ee-9b5e-7c2a6c24bf09 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:45.780456 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-439038d1-1ee7-42ee-9b5e-7c2a6c24bf09 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.252697 Jul 22 22:17:45.786623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 355/686] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:45 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:45.789624 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-65175648-cc4e-450b-9f17-93f988ad6525 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:45.790652 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-65175648-cc4e-450b-9f17-93f988ad6525 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:45.797992 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65175648-cc4e-450b-9f17-93f988ad6525 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:45.798534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65175648-cc4e-450b-9f17-93f988ad6525 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:45.800441 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65175648-cc4e-450b-9f17-93f988ad6525 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:45.800441 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65175648-cc4e-450b-9f17-93f988ad6525 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:45.817307 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0151ddb0-b487-4dc6-a241-601f0c3834b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:45.832533 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0151ddb0-b487-4dc6-a241-601f0c3834b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:45.834302 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0151ddb0-b487-4dc6-a241-601f0c3834b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:45.835589 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0151ddb0-b487-4dc6-a241-601f0c3834b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.261349 Jul 22 22:17:45.836390 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 332/687] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:45 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:46.008917 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-65175648-cc4e-450b-9f17-93f988ad6525 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:46.020673 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-65175648-cc4e-450b-9f17-93f988ad6525 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.237401 Jul 22 22:17:46.021717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 356/688] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:45 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:46.198219 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c99ff963-f778-472b-b117-4af1a29b9673 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:46.200535 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c99ff963-f778-472b-b117-4af1a29b9673 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:46.208199 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c99ff963-f778-472b-b117-4af1a29b9673 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:46.208915 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c99ff963-f778-472b-b117-4af1a29b9673 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:46.209887 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c99ff963-f778-472b-b117-4af1a29b9673 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:46.210472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c99ff963-f778-472b-b117-4af1a29b9673 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:46.396656 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c99ff963-f778-472b-b117-4af1a29b9673 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:46.407735 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c99ff963-f778-472b-b117-4af1a29b9673 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.214899 Jul 22 22:17:46.408355 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 333/689] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:46 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:46.803622 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e121cef3-b04b-4402-bac5-88a4a5ad153a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:46.804660 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e121cef3-b04b-4402-bac5-88a4a5ad153a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:46.811468 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e121cef3-b04b-4402-bac5-88a4a5ad153a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:46.811927 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e121cef3-b04b-4402-bac5-88a4a5ad153a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:46.812793 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e121cef3-b04b-4402-bac5-88a4a5ad153a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:46.813230 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e121cef3-b04b-4402-bac5-88a4a5ad153a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:46.855304 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0ec5baea-e201-408f-b8f5-2c79b5d7a417 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:46.856834 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0ec5baea-e201-408f-b8f5-2c79b5d7a417 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:46.864126 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ec5baea-e201-408f-b8f5-2c79b5d7a417 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:46.864677 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ec5baea-e201-408f-b8f5-2c79b5d7a417 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:46.865594 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ec5baea-e201-408f-b8f5-2c79b5d7a417 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:46.866477 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ec5baea-e201-408f-b8f5-2c79b5d7a417 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:47.011960 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e121cef3-b04b-4402-bac5-88a4a5ad153a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:47.041151 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e121cef3-b04b-4402-bac5-88a4a5ad153a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.240857 Jul 22 22:17:47.042327 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 357/690] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:46 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:47.058414 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-00cc1069-8bc9-4d09-b2ae-72d7d66e1f06 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:47.059100 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-00cc1069-8bc9-4d09-b2ae-72d7d66e1f06 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:47.065886 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-00cc1069-8bc9-4d09-b2ae-72d7d66e1f06 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:47.066334 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-00cc1069-8bc9-4d09-b2ae-72d7d66e1f06 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:47.067129 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-00cc1069-8bc9-4d09-b2ae-72d7d66e1f06 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:47.067588 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-00cc1069-8bc9-4d09-b2ae-72d7d66e1f06 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:47.070428 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0ec5baea-e201-408f-b8f5-2c79b5d7a417 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:47.084673 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0ec5baea-e201-408f-b8f5-2c79b5d7a417 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:47.086364 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0ec5baea-e201-408f-b8f5-2c79b5d7a417 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:47.087711 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0ec5baea-e201-408f-b8f5-2c79b5d7a417 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.236327 Jul 22 22:17:47.088503 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 334/691] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:46 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:47.243549 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-00cc1069-8bc9-4d09-b2ae-72d7d66e1f06 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:47.253132 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-00cc1069-8bc9-4d09-b2ae-72d7d66e1f06 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.198209 Jul 22 22:17:47.253850 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 358/692] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:47 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:47.426057 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-caea58b6-22a3-4a5d-863c-d4f576f05ffc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:47.427287 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-caea58b6-22a3-4a5d-863c-d4f576f05ffc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:47.437630 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-caea58b6-22a3-4a5d-863c-d4f576f05ffc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:47.438765 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-caea58b6-22a3-4a5d-863c-d4f576f05ffc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:47.443257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-caea58b6-22a3-4a5d-863c-d4f576f05ffc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:47.443257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-caea58b6-22a3-4a5d-863c-d4f576f05ffc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:47.644773 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-caea58b6-22a3-4a5d-863c-d4f576f05ffc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:47.655675 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-caea58b6-22a3-4a5d-863c-d4f576f05ffc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.232348 Jul 22 22:17:47.655675 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 335/693] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:47 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:48.061414 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-db7cd06f-f828-4c78-976f-bda085e60de1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:48.062205 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-db7cd06f-f828-4c78-976f-bda085e60de1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:48.068328 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-db7cd06f-f828-4c78-976f-bda085e60de1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:48.068787 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-db7cd06f-f828-4c78-976f-bda085e60de1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:48.069577 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-db7cd06f-f828-4c78-976f-bda085e60de1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:48.070007 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-db7cd06f-f828-4c78-976f-bda085e60de1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:48.120168 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5bcb8568-2418-42f8-8971-06d44575fe51 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:48.122408 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5bcb8568-2418-42f8-8971-06d44575fe51 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:48.128768 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5bcb8568-2418-42f8-8971-06d44575fe51 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:48.129226 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5bcb8568-2418-42f8-8971-06d44575fe51 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:48.130031 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5bcb8568-2418-42f8-8971-06d44575fe51 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:48.130475 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5bcb8568-2418-42f8-8971-06d44575fe51 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:48.267088 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-db7cd06f-f828-4c78-976f-bda085e60de1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:48.280232 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-db7cd06f-f828-4c78-976f-bda085e60de1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.222539 Jul 22 22:17:48.293534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 359/694] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:48 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:48.293534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8194783c-4562-4ec9-a8f7-6b57e6820a4d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:48.293534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8194783c-4562-4ec9-a8f7-6b57e6820a4d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:48.296430 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8194783c-4562-4ec9-a8f7-6b57e6820a4d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:48.297380 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8194783c-4562-4ec9-a8f7-6b57e6820a4d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:48.298194 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8194783c-4562-4ec9-a8f7-6b57e6820a4d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:48.298625 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8194783c-4562-4ec9-a8f7-6b57e6820a4d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:48.353576 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5bcb8568-2418-42f8-8971-06d44575fe51 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:48.363399 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5bcb8568-2418-42f8-8971-06d44575fe51 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:48.365325 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5bcb8568-2418-42f8-8971-06d44575fe51 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:48.366731 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5bcb8568-2418-42f8-8971-06d44575fe51 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.250914 Jul 22 22:17:48.367479 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 336/695] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:48 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:48.488657 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8194783c-4562-4ec9-a8f7-6b57e6820a4d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:48.511765 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8194783c-4562-4ec9-a8f7-6b57e6820a4d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.229255 Jul 22 22:17:48.514514 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 360/696] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:48 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:48.672715 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9659c7fd-17e2-4895-8f3b-4a668fb4a2c8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:48.673394 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9659c7fd-17e2-4895-8f3b-4a668fb4a2c8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:48.679872 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9659c7fd-17e2-4895-8f3b-4a668fb4a2c8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:48.680357 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9659c7fd-17e2-4895-8f3b-4a668fb4a2c8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:48.681166 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9659c7fd-17e2-4895-8f3b-4a668fb4a2c8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:48.681607 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9659c7fd-17e2-4895-8f3b-4a668fb4a2c8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:48.877784 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9659c7fd-17e2-4895-8f3b-4a668fb4a2c8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:48.886927 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9659c7fd-17e2-4895-8f3b-4a668fb4a2c8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.218685 Jul 22 22:17:48.888932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 337/697] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:48 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:49.310139 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4333824d-03ea-4622-b81c-8a44bb2e47cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:49.310820 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4333824d-03ea-4622-b81c-8a44bb2e47cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:49.317473 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4333824d-03ea-4622-b81c-8a44bb2e47cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:49.317954 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4333824d-03ea-4622-b81c-8a44bb2e47cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:49.318696 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4333824d-03ea-4622-b81c-8a44bb2e47cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:49.320078 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4333824d-03ea-4622-b81c-8a44bb2e47cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:49.386492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-40661cfa-39ff-4f18-9343-0b1893408f06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:49.388464 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-40661cfa-39ff-4f18-9343-0b1893408f06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:49.394602 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-40661cfa-39ff-4f18-9343-0b1893408f06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:49.395049 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-40661cfa-39ff-4f18-9343-0b1893408f06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:49.395894 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-40661cfa-39ff-4f18-9343-0b1893408f06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:49.396361 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-40661cfa-39ff-4f18-9343-0b1893408f06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:49.489904 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4333824d-03ea-4622-b81c-8a44bb2e47cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:49.501777 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4333824d-03ea-4622-b81c-8a44bb2e47cf tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.196768 Jul 22 22:17:49.502697 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 361/698] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:49 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:49.535146 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8def8578-f997-413c-b8d2-1f572e2ec105 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:49.536566 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8def8578-f997-413c-b8d2-1f572e2ec105 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:49.546918 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8def8578-f997-413c-b8d2-1f572e2ec105 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:49.547653 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8def8578-f997-413c-b8d2-1f572e2ec105 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:49.548987 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8def8578-f997-413c-b8d2-1f572e2ec105 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:49.549717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8def8578-f997-413c-b8d2-1f572e2ec105 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:49.573327 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-40661cfa-39ff-4f18-9343-0b1893408f06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:49.582731 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-40661cfa-39ff-4f18-9343-0b1893408f06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:49.584246 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-40661cfa-39ff-4f18-9343-0b1893408f06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:49.585470 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-40661cfa-39ff-4f18-9343-0b1893408f06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.202898 Jul 22 22:17:49.586216 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 338/699] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:49 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:49.714825 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8def8578-f997-413c-b8d2-1f572e2ec105 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:49.724462 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8def8578-f997-413c-b8d2-1f572e2ec105 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.196813 Jul 22 22:17:49.729147 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 362/700] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:49 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:49.907233 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ec87077a-01fd-4bcf-ba23-0c91d7cc161a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:49.907783 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ec87077a-01fd-4bcf-ba23-0c91d7cc161a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:49.913849 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ec87077a-01fd-4bcf-ba23-0c91d7cc161a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:49.914296 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ec87077a-01fd-4bcf-ba23-0c91d7cc161a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:49.915183 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ec87077a-01fd-4bcf-ba23-0c91d7cc161a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:49.915520 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ec87077a-01fd-4bcf-ba23-0c91d7cc161a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:50.067040 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ec87077a-01fd-4bcf-ba23-0c91d7cc161a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:50.076328 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ec87077a-01fd-4bcf-ba23-0c91d7cc161a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.173717 Jul 22 22:17:50.076933 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 339/701] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:49 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:50.520875 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c8e07d39-5424-4e20-8c53-2a806bfcac33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:50.521532 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c8e07d39-5424-4e20-8c53-2a806bfcac33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:50.528670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c8e07d39-5424-4e20-8c53-2a806bfcac33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:50.529410 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c8e07d39-5424-4e20-8c53-2a806bfcac33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:50.530352 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c8e07d39-5424-4e20-8c53-2a806bfcac33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:50.530798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c8e07d39-5424-4e20-8c53-2a806bfcac33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:50.606706 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3ff60759-1e08-4cdd-a407-3b7abb1e953a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:50.607195 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3ff60759-1e08-4cdd-a407-3b7abb1e953a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:50.613450 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3ff60759-1e08-4cdd-a407-3b7abb1e953a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:50.613895 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3ff60759-1e08-4cdd-a407-3b7abb1e953a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:50.614697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3ff60759-1e08-4cdd-a407-3b7abb1e953a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:50.615127 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3ff60759-1e08-4cdd-a407-3b7abb1e953a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:50.743177 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c8e07d39-5424-4e20-8c53-2a806bfcac33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:50.770157 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c8e07d39-5424-4e20-8c53-2a806bfcac33 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.253645 Jul 22 22:17:50.772239 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 363/702] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:50 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:50.780318 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9095e31a-9868-4207-8d6e-9ea7324f4b5c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:50.782006 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9095e31a-9868-4207-8d6e-9ea7324f4b5c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:50.788636 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9095e31a-9868-4207-8d6e-9ea7324f4b5c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:50.789422 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9095e31a-9868-4207-8d6e-9ea7324f4b5c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:50.790419 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9095e31a-9868-4207-8d6e-9ea7324f4b5c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:50.791057 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9095e31a-9868-4207-8d6e-9ea7324f4b5c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:50.815799 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3ff60759-1e08-4cdd-a407-3b7abb1e953a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:50.825265 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3ff60759-1e08-4cdd-a407-3b7abb1e953a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:50.826906 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3ff60759-1e08-4cdd-a407-3b7abb1e953a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:50.828229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3ff60759-1e08-4cdd-a407-3b7abb1e953a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.226549 Jul 22 22:17:50.829154 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 340/703] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:50 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:50.944952 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9095e31a-9868-4207-8d6e-9ea7324f4b5c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:50.952944 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9095e31a-9868-4207-8d6e-9ea7324f4b5c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.178724 Jul 22 22:17:50.953530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 364/704] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:50 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:51.094289 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0ab2d0b3-78a1-4094-b8e9-1ea910de8094 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:51.094923 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0ab2d0b3-78a1-4094-b8e9-1ea910de8094 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:51.101401 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ab2d0b3-78a1-4094-b8e9-1ea910de8094 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:51.101835 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ab2d0b3-78a1-4094-b8e9-1ea910de8094 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:51.102628 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ab2d0b3-78a1-4094-b8e9-1ea910de8094 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:51.103067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ab2d0b3-78a1-4094-b8e9-1ea910de8094 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:51.277000 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0ab2d0b3-78a1-4094-b8e9-1ea910de8094 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:51.287460 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0ab2d0b3-78a1-4094-b8e9-1ea910de8094 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.197351 Jul 22 22:17:51.288053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 341/705] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:51 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:51.788664 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d808c8b6-811a-468f-984f-868fe6dc25e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:51.789284 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d808c8b6-811a-468f-984f-868fe6dc25e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:51.797394 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d808c8b6-811a-468f-984f-868fe6dc25e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:51.797992 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d808c8b6-811a-468f-984f-868fe6dc25e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:51.798955 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d808c8b6-811a-468f-984f-868fe6dc25e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:51.799494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d808c8b6-811a-468f-984f-868fe6dc25e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:51.858754 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1367b749-6bd0-49f5-8d66-ba7dd29729da tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:51.859472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1367b749-6bd0-49f5-8d66-ba7dd29729da tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:51.866270 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1367b749-6bd0-49f5-8d66-ba7dd29729da tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:51.866593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1367b749-6bd0-49f5-8d66-ba7dd29729da tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:51.867399 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1367b749-6bd0-49f5-8d66-ba7dd29729da tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:51.867745 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1367b749-6bd0-49f5-8d66-ba7dd29729da tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:51.992237 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d808c8b6-811a-468f-984f-868fe6dc25e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:52.001717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d808c8b6-811a-468f-984f-868fe6dc25e1 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.216691 Jul 22 22:17:52.002407 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 365/706] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:51 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:52.021289 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d80e8d34-1844-475b-9051-323081da017e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:52.021790 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d80e8d34-1844-475b-9051-323081da017e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:52.029099 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d80e8d34-1844-475b-9051-323081da017e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:52.029550 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d80e8d34-1844-475b-9051-323081da017e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:52.030669 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d80e8d34-1844-475b-9051-323081da017e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:52.031183 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d80e8d34-1844-475b-9051-323081da017e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:52.073344 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1367b749-6bd0-49f5-8d66-ba7dd29729da tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:52.083860 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1367b749-6bd0-49f5-8d66-ba7dd29729da tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:52.086058 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1367b749-6bd0-49f5-8d66-ba7dd29729da tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:52.087351 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1367b749-6bd0-49f5-8d66-ba7dd29729da tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.233058 Jul 22 22:17:52.088173 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 342/707] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:51 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:52.203095 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d80e8d34-1844-475b-9051-323081da017e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:52.213957 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d80e8d34-1844-475b-9051-323081da017e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.210372 Jul 22 22:17:52.214556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 366/708] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:52 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:52.307157 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-02c3ca70-7045-4af7-b491-e950f851609e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:52.307990 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-02c3ca70-7045-4af7-b491-e950f851609e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:52.317029 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-02c3ca70-7045-4af7-b491-e950f851609e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:52.317480 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-02c3ca70-7045-4af7-b491-e950f851609e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:52.318272 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-02c3ca70-7045-4af7-b491-e950f851609e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:52.318709 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-02c3ca70-7045-4af7-b491-e950f851609e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:52.480177 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-02c3ca70-7045-4af7-b491-e950f851609e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:52.489291 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-02c3ca70-7045-4af7-b491-e950f851609e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.186255 Jul 22 22:17:52.489773 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 343/709] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:52 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:53.029297 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-de0eedbe-95c7-49e2-a332-56f144019733 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:53.029985 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-de0eedbe-95c7-49e2-a332-56f144019733 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:53.036058 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-de0eedbe-95c7-49e2-a332-56f144019733 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:53.036530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-de0eedbe-95c7-49e2-a332-56f144019733 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:53.037459 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-de0eedbe-95c7-49e2-a332-56f144019733 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:53.037892 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-de0eedbe-95c7-49e2-a332-56f144019733 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:53.107762 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b4d7ea91-df7b-4da3-8c1a-65208930a8e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:53.108388 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b4d7ea91-df7b-4da3-8c1a-65208930a8e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:53.114697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4d7ea91-df7b-4da3-8c1a-65208930a8e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:53.115150 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4d7ea91-df7b-4da3-8c1a-65208930a8e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:53.115933 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4d7ea91-df7b-4da3-8c1a-65208930a8e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:53.116401 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4d7ea91-df7b-4da3-8c1a-65208930a8e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:53.209435 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-de0eedbe-95c7-49e2-a332-56f144019733 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:53.219269 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-de0eedbe-95c7-49e2-a332-56f144019733 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.193953 Jul 22 22:17:53.220728 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 367/710] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:53 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:53.236077 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d97f41ec-7d7d-443d-b288-32b18956ef90 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:53.236797 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d97f41ec-7d7d-443d-b288-32b18956ef90 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:53.243945 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d97f41ec-7d7d-443d-b288-32b18956ef90 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:53.244570 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d97f41ec-7d7d-443d-b288-32b18956ef90 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:53.245709 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d97f41ec-7d7d-443d-b288-32b18956ef90 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:53.246772 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d97f41ec-7d7d-443d-b288-32b18956ef90 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:53.306123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b4d7ea91-df7b-4da3-8c1a-65208930a8e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:53.326011 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b4d7ea91-df7b-4da3-8c1a-65208930a8e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:53.327520 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b4d7ea91-df7b-4da3-8c1a-65208930a8e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:53.329007 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b4d7ea91-df7b-4da3-8c1a-65208930a8e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.225704 Jul 22 22:17:53.329568 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 344/711] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:53 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:53.404938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d97f41ec-7d7d-443d-b288-32b18956ef90 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:53.413889 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d97f41ec-7d7d-443d-b288-32b18956ef90 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.183935 Jul 22 22:17:53.414984 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 368/712] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:53 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:53.506932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c9e137f4-e307-489b-9a02-129ed3cc05b3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:53.507685 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c9e137f4-e307-489b-9a02-129ed3cc05b3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:53.514652 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c9e137f4-e307-489b-9a02-129ed3cc05b3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:53.515158 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c9e137f4-e307-489b-9a02-129ed3cc05b3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:53.515936 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c9e137f4-e307-489b-9a02-129ed3cc05b3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:53.516473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c9e137f4-e307-489b-9a02-129ed3cc05b3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:53.696998 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c9e137f4-e307-489b-9a02-129ed3cc05b3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:53.710553 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c9e137f4-e307-489b-9a02-129ed3cc05b3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.207188 Jul 22 22:17:53.711138 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 345/713] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:53 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:54.240422 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-35b6143d-dc64-450a-b3e6-348f605d1912 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:54.241154 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-35b6143d-dc64-450a-b3e6-348f605d1912 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:54.248201 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35b6143d-dc64-450a-b3e6-348f605d1912 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:54.248663 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35b6143d-dc64-450a-b3e6-348f605d1912 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:54.249436 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35b6143d-dc64-450a-b3e6-348f605d1912 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:54.249862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35b6143d-dc64-450a-b3e6-348f605d1912 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:54.350453 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a98d8036-6abe-4725-a770-a1ab50390b48 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:54.351234 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a98d8036-6abe-4725-a770-a1ab50390b48 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:54.368348 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a98d8036-6abe-4725-a770-a1ab50390b48 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:54.368817 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a98d8036-6abe-4725-a770-a1ab50390b48 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:54.369598 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a98d8036-6abe-4725-a770-a1ab50390b48 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:54.370043 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a98d8036-6abe-4725-a770-a1ab50390b48 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:54.436492 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-35b6143d-dc64-450a-b3e6-348f605d1912 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:54.443568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-35b6143d-dc64-450a-b3e6-348f605d1912 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.209349 Jul 22 22:17:54.445203 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 369/714] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:54 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:54.449416 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-03f8a70b-bc76-4a8d-91b8-aae1b8e02f93 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:54.450594 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-03f8a70b-bc76-4a8d-91b8-aae1b8e02f93 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:54.461260 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03f8a70b-bc76-4a8d-91b8-aae1b8e02f93 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:54.462092 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03f8a70b-bc76-4a8d-91b8-aae1b8e02f93 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:54.463124 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03f8a70b-bc76-4a8d-91b8-aae1b8e02f93 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:54.463781 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-03f8a70b-bc76-4a8d-91b8-aae1b8e02f93 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:54.560582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a98d8036-6abe-4725-a770-a1ab50390b48 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:54.569446 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a98d8036-6abe-4725-a770-a1ab50390b48 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:54.570999 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a98d8036-6abe-4725-a770-a1ab50390b48 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:54.572303 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a98d8036-6abe-4725-a770-a1ab50390b48 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.225745 Jul 22 22:17:54.573137 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 346/715] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:54 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:54.626212 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-03f8a70b-bc76-4a8d-91b8-aae1b8e02f93 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:54.634078 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-03f8a70b-bc76-4a8d-91b8-aae1b8e02f93 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.188834 Jul 22 22:17:54.634661 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 370/716] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:54 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:54.734278 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-39f2a2cf-be4d-4e4c-8c2b-e88375e02678 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:54.735473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-39f2a2cf-be4d-4e4c-8c2b-e88375e02678 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:54.742333 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39f2a2cf-be4d-4e4c-8c2b-e88375e02678 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:54.742765 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39f2a2cf-be4d-4e4c-8c2b-e88375e02678 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:54.743542 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39f2a2cf-be4d-4e4c-8c2b-e88375e02678 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:54.743968 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39f2a2cf-be4d-4e4c-8c2b-e88375e02678 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:54.914041 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-39f2a2cf-be4d-4e4c-8c2b-e88375e02678 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:54.924779 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-39f2a2cf-be4d-4e4c-8c2b-e88375e02678 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.195595 Jul 22 22:17:54.925371 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 347/717] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:54 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:55.468447 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-123bbae4-93f0-4a36-b68c-7e13c39b6e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:55.469063 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-123bbae4-93f0-4a36-b68c-7e13c39b6e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:55.475969 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-123bbae4-93f0-4a36-b68c-7e13c39b6e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:55.476459 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-123bbae4-93f0-4a36-b68c-7e13c39b6e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:55.477259 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-123bbae4-93f0-4a36-b68c-7e13c39b6e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:55.477851 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-123bbae4-93f0-4a36-b68c-7e13c39b6e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:55.592935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-393aae45-7354-4bb0-95b1-34cbc5acd2f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:55.593578 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-393aae45-7354-4bb0-95b1-34cbc5acd2f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:55.600662 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-393aae45-7354-4bb0-95b1-34cbc5acd2f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:55.601397 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-393aae45-7354-4bb0-95b1-34cbc5acd2f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:55.602479 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-393aae45-7354-4bb0-95b1-34cbc5acd2f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:55.603088 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-393aae45-7354-4bb0-95b1-34cbc5acd2f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:55.646982 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-123bbae4-93f0-4a36-b68c-7e13c39b6e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:55.655459 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-123bbae4-93f0-4a36-b68c-7e13c39b6e6a tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.191869 Jul 22 22:17:55.656157 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 371/718] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:55 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:55.660801 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e36d486f-bb54-46d3-b080-31fe2d44694f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:55.661418 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e36d486f-bb54-46d3-b080-31fe2d44694f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:55.670136 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e36d486f-bb54-46d3-b080-31fe2d44694f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:55.670594 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e36d486f-bb54-46d3-b080-31fe2d44694f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:55.671394 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e36d486f-bb54-46d3-b080-31fe2d44694f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:55.671953 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e36d486f-bb54-46d3-b080-31fe2d44694f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:55.786791 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-393aae45-7354-4bb0-95b1-34cbc5acd2f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:55.799742 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-393aae45-7354-4bb0-95b1-34cbc5acd2f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:55.801440 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-393aae45-7354-4bb0-95b1-34cbc5acd2f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:55.802603 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-393aae45-7354-4bb0-95b1-34cbc5acd2f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.215039 Jul 22 22:17:55.803201 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 348/719] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:55 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:17:55.862199 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e36d486f-bb54-46d3-b080-31fe2d44694f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:55.875569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e36d486f-bb54-46d3-b080-31fe2d44694f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.218098 Jul 22 22:17:55.876730 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 372/720] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:55 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:55.950878 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8834eea0-84b2-4297-a05d-9043d5bf0194 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:55.951492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8834eea0-84b2-4297-a05d-9043d5bf0194 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:55.958929 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8834eea0-84b2-4297-a05d-9043d5bf0194 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:55.959381 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8834eea0-84b2-4297-a05d-9043d5bf0194 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:55.960169 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8834eea0-84b2-4297-a05d-9043d5bf0194 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:55.960637 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8834eea0-84b2-4297-a05d-9043d5bf0194 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:56.140828 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8834eea0-84b2-4297-a05d-9043d5bf0194 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:56.151460 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8834eea0-84b2-4297-a05d-9043d5bf0194 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.204355 Jul 22 22:17:56.153975 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 349/721] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:55 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:56.673039 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-771fe44b-c8db-4581-9025-af561237a030 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:56.673626 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-771fe44b-c8db-4581-9025-af561237a030 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:56.679795 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-771fe44b-c8db-4581-9025-af561237a030 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:56.680239 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-771fe44b-c8db-4581-9025-af561237a030 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:56.681052 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-771fe44b-c8db-4581-9025-af561237a030 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:56.681489 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-771fe44b-c8db-4581-9025-af561237a030 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:56.823537 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bcc7fa1a-b6a5-4b3d-b28b-4dac6afd8a85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:56.825232 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bcc7fa1a-b6a5-4b3d-b28b-4dac6afd8a85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:56.832072 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bcc7fa1a-b6a5-4b3d-b28b-4dac6afd8a85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:56.833266 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bcc7fa1a-b6a5-4b3d-b28b-4dac6afd8a85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:56.834313 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bcc7fa1a-b6a5-4b3d-b28b-4dac6afd8a85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:56.834752 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bcc7fa1a-b6a5-4b3d-b28b-4dac6afd8a85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:56.867745 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-771fe44b-c8db-4581-9025-af561237a030 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:56.877417 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-771fe44b-c8db-4581-9025-af561237a030 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.206889 Jul 22 22:17:56.879274 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 373/722] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:56 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:56.903838 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-aa486571-7f8c-4d7e-8282-9649a842edf7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:56.904685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-aa486571-7f8c-4d7e-8282-9649a842edf7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:56.915715 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aa486571-7f8c-4d7e-8282-9649a842edf7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:56.915715 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aa486571-7f8c-4d7e-8282-9649a842edf7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:56.916045 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aa486571-7f8c-4d7e-8282-9649a842edf7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:56.920510 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aa486571-7f8c-4d7e-8282-9649a842edf7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:57.008928 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bcc7fa1a-b6a5-4b3d-b28b-4dac6afd8a85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:57.019132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bcc7fa1a-b6a5-4b3d-b28b-4dac6afd8a85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:57.020705 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bcc7fa1a-b6a5-4b3d-b28b-4dac6afd8a85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:57.021983 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bcc7fa1a-b6a5-4b3d-b28b-4dac6afd8a85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.202079 Jul 22 22:17:57.022580 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 350/723] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:56 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:57.069725 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-aa486571-7f8c-4d7e-8282-9649a842edf7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:57.078146 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-aa486571-7f8c-4d7e-8282-9649a842edf7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.179459 Jul 22 22:17:57.078938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 374/724] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:56 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:57.174185 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-97271dc3-269e-4b7d-acbb-10861fa9fb41 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:57.174877 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-97271dc3-269e-4b7d-acbb-10861fa9fb41 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:57.181523 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-97271dc3-269e-4b7d-acbb-10861fa9fb41 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:57.182082 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-97271dc3-269e-4b7d-acbb-10861fa9fb41 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:57.182960 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-97271dc3-269e-4b7d-acbb-10861fa9fb41 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:57.183535 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-97271dc3-269e-4b7d-acbb-10861fa9fb41 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:57.357088 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-97271dc3-269e-4b7d-acbb-10861fa9fb41 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:57.369053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-97271dc3-269e-4b7d-acbb-10861fa9fb41 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.198697 Jul 22 22:17:57.371724 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 351/725] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:57 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:57.896093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-88b4f91b-c37a-4811-b641-696c8d5cc8b5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:57.896739 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-88b4f91b-c37a-4811-b641-696c8d5cc8b5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:57.903939 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-88b4f91b-c37a-4811-b641-696c8d5cc8b5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:57.904440 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-88b4f91b-c37a-4811-b641-696c8d5cc8b5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:57.905217 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-88b4f91b-c37a-4811-b641-696c8d5cc8b5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:57.905648 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-88b4f91b-c37a-4811-b641-696c8d5cc8b5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:58.044747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-42a7e406-eb05-4c0d-97bc-fef5f8d026f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:58.045367 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-42a7e406-eb05-4c0d-97bc-fef5f8d026f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:58.051390 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a7e406-eb05-4c0d-97bc-fef5f8d026f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:58.051736 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a7e406-eb05-4c0d-97bc-fef5f8d026f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:58.052540 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a7e406-eb05-4c0d-97bc-fef5f8d026f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:58.053008 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a7e406-eb05-4c0d-97bc-fef5f8d026f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:58.057295 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-88b4f91b-c37a-4811-b641-696c8d5cc8b5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:58.065625 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-88b4f91b-c37a-4811-b641-696c8d5cc8b5 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.173252 Jul 22 22:17:58.066298 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 375/726] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:57 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:58.095315 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-485c259d-179d-415a-8fc0-66a9f6ec51c1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:58.095612 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-485c259d-179d-415a-8fc0-66a9f6ec51c1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:58.103366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-485c259d-179d-415a-8fc0-66a9f6ec51c1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:58.103742 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-485c259d-179d-415a-8fc0-66a9f6ec51c1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:58.104619 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-485c259d-179d-415a-8fc0-66a9f6ec51c1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:58.106065 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-485c259d-179d-415a-8fc0-66a9f6ec51c1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:58.205202 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-42a7e406-eb05-4c0d-97bc-fef5f8d026f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:58.213958 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-42a7e406-eb05-4c0d-97bc-fef5f8d026f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:58.215515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-42a7e406-eb05-4c0d-97bc-fef5f8d026f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:58.216738 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-42a7e406-eb05-4c0d-97bc-fef5f8d026f3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.177742 Jul 22 22:17:58.217306 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 352/727] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:58 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:58.258116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-485c259d-179d-415a-8fc0-66a9f6ec51c1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:58.265716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-485c259d-179d-415a-8fc0-66a9f6ec51c1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.174601 Jul 22 22:17:58.266293 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 376/728] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:58 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:17:58.391628 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3e6ed1d6-fb4b-4d83-aa6d-90b68688d6b8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:58.392355 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3e6ed1d6-fb4b-4d83-aa6d-90b68688d6b8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:58.398399 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e6ed1d6-fb4b-4d83-aa6d-90b68688d6b8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:58.398859 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e6ed1d6-fb4b-4d83-aa6d-90b68688d6b8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:58.399640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e6ed1d6-fb4b-4d83-aa6d-90b68688d6b8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:58.400104 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e6ed1d6-fb4b-4d83-aa6d-90b68688d6b8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:58.552478 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3e6ed1d6-fb4b-4d83-aa6d-90b68688d6b8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:58.561406 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3e6ed1d6-fb4b-4d83-aa6d-90b68688d6b8 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.173906 Jul 22 22:17:58.561985 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 353/729] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:58 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:59.083405 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-75a444c5-26ba-4295-86de-e7224791be30 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:59.084020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-75a444c5-26ba-4295-86de-e7224791be30 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:59.090975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-75a444c5-26ba-4295-86de-e7224791be30 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:59.091427 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-75a444c5-26ba-4295-86de-e7224791be30 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:59.092216 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-75a444c5-26ba-4295-86de-e7224791be30 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:59.092680 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-75a444c5-26ba-4295-86de-e7224791be30 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:59.235679 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-93a006a6-45f6-4027-9e1a-94c3806ae18c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:59.236317 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-93a006a6-45f6-4027-9e1a-94c3806ae18c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:59.242781 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-93a006a6-45f6-4027-9e1a-94c3806ae18c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:59.243225 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-93a006a6-45f6-4027-9e1a-94c3806ae18c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:59.244008 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-93a006a6-45f6-4027-9e1a-94c3806ae18c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:59.244600 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-93a006a6-45f6-4027-9e1a-94c3806ae18c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:59.270413 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-75a444c5-26ba-4295-86de-e7224791be30 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:59.280978 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-75a444c5-26ba-4295-86de-e7224791be30 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.201241 Jul 22 22:17:59.282509 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 377/730] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:59 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:59.286487 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b765e605-4dc1-4a02-9b13-a74a34b372dd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:59.287095 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b765e605-4dc1-4a02-9b13-a74a34b372dd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:59.293320 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b765e605-4dc1-4a02-9b13-a74a34b372dd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:59.293733 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b765e605-4dc1-4a02-9b13-a74a34b372dd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:59.294507 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b765e605-4dc1-4a02-9b13-a74a34b372dd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:59.294937 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b765e605-4dc1-4a02-9b13-a74a34b372dd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:59.452710 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-93a006a6-45f6-4027-9e1a-94c3806ae18c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:59.461710 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-93a006a6-45f6-4027-9e1a-94c3806ae18c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:59.463236 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-93a006a6-45f6-4027-9e1a-94c3806ae18c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:59.464980 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-93a006a6-45f6-4027-9e1a-94c3806ae18c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.232497 Jul 22 22:17:59.465958 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 354/731] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:17:59 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:17:59.573938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b765e605-4dc1-4a02-9b13-a74a34b372dd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:59.579534 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b1afa77b-9e70-4a08-9260-7a016d41f58f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:17:59.580150 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b1afa77b-9e70-4a08-9260-7a016d41f58f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:17:59.582287 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b765e605-4dc1-4a02-9b13-a74a34b372dd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.299521 Jul 22 22:17:59.583086 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 378/732] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:59 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:17:59.586247 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b1afa77b-9e70-4a08-9260-7a016d41f58f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:59.586700 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b1afa77b-9e70-4a08-9260-7a016d41f58f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:59.587482 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b1afa77b-9e70-4a08-9260-7a016d41f58f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:17:59.587921 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b1afa77b-9e70-4a08-9260-7a016d41f58f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:17:59.736632 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b1afa77b-9e70-4a08-9260-7a016d41f58f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:17:59.744624 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b1afa77b-9e70-4a08-9260-7a016d41f58f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1754 microversion: 2.1 time: 0.168674 Jul 22 22:17:59.745203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 355/733] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:17:59 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:00.298334 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4d74bb02-2bb2-4937-9027-e8fa483f3d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:00.298939 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4d74bb02-2bb2-4937-9027-e8fa483f3d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:00.305104 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d74bb02-2bb2-4937-9027-e8fa483f3d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:00.305543 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d74bb02-2bb2-4937-9027-e8fa483f3d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:00.306366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d74bb02-2bb2-4937-9027-e8fa483f3d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:00.306792 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4d74bb02-2bb2-4937-9027-e8fa483f3d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:00.483251 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-286c8cea-e865-48ff-82c9-d3ca4a2708ff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:00.483804 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-286c8cea-e865-48ff-82c9-d3ca4a2708ff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:00.490015 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-286c8cea-e865-48ff-82c9-d3ca4a2708ff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:00.490473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-286c8cea-e865-48ff-82c9-d3ca4a2708ff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:00.491255 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-286c8cea-e865-48ff-82c9-d3ca4a2708ff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:00.491732 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-286c8cea-e865-48ff-82c9-d3ca4a2708ff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:00.639002 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-286c8cea-e865-48ff-82c9-d3ca4a2708ff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:00.647739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-286c8cea-e865-48ff-82c9-d3ca4a2708ff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:00.649245 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-286c8cea-e865-48ff-82c9-d3ca4a2708ff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:00.650381 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-286c8cea-e865-48ff-82c9-d3ca4a2708ff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.171203 Jul 22 22:18:00.650929 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 356/734] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:00 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:18:00.655708 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-06f4899a-2263-4d45-b064-6f6bb22abbe8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:00.656320 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-06f4899a-2263-4d45-b064-6f6bb22abbe8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:00.662236 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-06f4899a-2263-4d45-b064-6f6bb22abbe8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:00.662683 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-06f4899a-2263-4d45-b064-6f6bb22abbe8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:00.663453 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-06f4899a-2263-4d45-b064-6f6bb22abbe8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:00.663880 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-06f4899a-2263-4d45-b064-6f6bb22abbe8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:00.664220 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4d74bb02-2bb2-4937-9027-e8fa483f3d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:00.672377 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4d74bb02-2bb2-4937-9027-e8fa483f3d0b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.377747 Jul 22 22:18:00.672952 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 379/735] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:00 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:00.761945 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d8373c9b-f00c-40dc-9ee5-e3376a5314d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:00.762782 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d8373c9b-f00c-40dc-9ee5-e3376a5314d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:00.769766 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d8373c9b-f00c-40dc-9ee5-e3376a5314d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:00.770205 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d8373c9b-f00c-40dc-9ee5-e3376a5314d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:00.770971 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d8373c9b-f00c-40dc-9ee5-e3376a5314d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:00.771397 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d8373c9b-f00c-40dc-9ee5-e3376a5314d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:00.804205 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-06f4899a-2263-4d45-b064-6f6bb22abbe8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:00.812414 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-06f4899a-2263-4d45-b064-6f6bb22abbe8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.160448 Jul 22 22:18:00.813006 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 357/736] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:00 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:00.912998 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d8373c9b-f00c-40dc-9ee5-e3376a5314d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:00.921411 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d8373c9b-f00c-40dc-9ee5-e3376a5314d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.163318 Jul 22 22:18:00.921975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 380/737] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:00 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:01.669558 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e9a89836-8b7b-4535-8c0a-6dad6f8372e7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:01.670171 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e9a89836-8b7b-4535-8c0a-6dad6f8372e7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:01.676458 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e9a89836-8b7b-4535-8c0a-6dad6f8372e7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:01.676904 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e9a89836-8b7b-4535-8c0a-6dad6f8372e7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:01.677683 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e9a89836-8b7b-4535-8c0a-6dad6f8372e7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:01.678113 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e9a89836-8b7b-4535-8c0a-6dad6f8372e7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:01.689582 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e246e134-e64f-45d6-b5d9-ffce4699c922 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:01.690180 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e246e134-e64f-45d6-b5d9-ffce4699c922 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:01.696318 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e246e134-e64f-45d6-b5d9-ffce4699c922 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:01.696765 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e246e134-e64f-45d6-b5d9-ffce4699c922 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:01.697539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e246e134-e64f-45d6-b5d9-ffce4699c922 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:01.698001 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e246e134-e64f-45d6-b5d9-ffce4699c922 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:01.847076 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e9a89836-8b7b-4535-8c0a-6dad6f8372e7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:01.856721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e9a89836-8b7b-4535-8c0a-6dad6f8372e7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:01.857589 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e246e134-e64f-45d6-b5d9-ffce4699c922 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:01.858243 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e9a89836-8b7b-4535-8c0a-6dad6f8372e7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:01.859474 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e9a89836-8b7b-4535-8c0a-6dad6f8372e7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.194412 Jul 22 22:18:01.859983 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 358/738] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:01 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:18:01.864302 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-db52d50f-52a5-4bdf-8765-9a4422c0f23a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:01.864916 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-db52d50f-52a5-4bdf-8765-9a4422c0f23a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:01.865236 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e246e134-e64f-45d6-b5d9-ffce4699c922 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.179266 Jul 22 22:18:01.868684 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 381/739] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:01 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:01.875474 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-db52d50f-52a5-4bdf-8765-9a4422c0f23a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:01.876165 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-db52d50f-52a5-4bdf-8765-9a4422c0f23a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:01.877010 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-db52d50f-52a5-4bdf-8765-9a4422c0f23a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:01.877472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-db52d50f-52a5-4bdf-8765-9a4422c0f23a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:01.939654 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-97457220-7731-41ee-a758-c7c108bf3125 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:01.940172 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-97457220-7731-41ee-a758-c7c108bf3125 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:01.946385 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-97457220-7731-41ee-a758-c7c108bf3125 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:01.947024 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-97457220-7731-41ee-a758-c7c108bf3125 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:01.947604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-97457220-7731-41ee-a758-c7c108bf3125 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:01.948041 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-97457220-7731-41ee-a758-c7c108bf3125 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:02.025982 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-db52d50f-52a5-4bdf-8765-9a4422c0f23a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:02.034099 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-db52d50f-52a5-4bdf-8765-9a4422c0f23a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.173032 Jul 22 22:18:02.034777 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 359/740] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:01 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:02.119331 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-97457220-7731-41ee-a758-c7c108bf3125 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:02.128350 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-97457220-7731-41ee-a758-c7c108bf3125 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.192637 Jul 22 22:18:02.128940 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 382/741] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:01 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:02.877650 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1f41865a-0edd-4a8d-98ec-d00c502e58c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:02.878265 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1f41865a-0edd-4a8d-98ec-d00c502e58c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:02.882405 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-566ae75f-4577-4e56-a269-eb17aa1e1f53 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:02.883803 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-566ae75f-4577-4e56-a269-eb17aa1e1f53 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:02.884571 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1f41865a-0edd-4a8d-98ec-d00c502e58c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:02.885032 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1f41865a-0edd-4a8d-98ec-d00c502e58c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:02.885820 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1f41865a-0edd-4a8d-98ec-d00c502e58c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:02.887103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1f41865a-0edd-4a8d-98ec-d00c502e58c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:02.890572 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-566ae75f-4577-4e56-a269-eb17aa1e1f53 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:02.891014 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-566ae75f-4577-4e56-a269-eb17aa1e1f53 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:02.891795 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-566ae75f-4577-4e56-a269-eb17aa1e1f53 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:02.892249 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-566ae75f-4577-4e56-a269-eb17aa1e1f53 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:03.036333 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1f41865a-0edd-4a8d-98ec-d00c502e58c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:03.038414 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-566ae75f-4577-4e56-a269-eb17aa1e1f53 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:03.045181 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1f41865a-0edd-4a8d-98ec-d00c502e58c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:03.046584 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-566ae75f-4577-4e56-a269-eb17aa1e1f53 tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1517 microversion: 2.1 time: 0.167930 Jul 22 22:18:03.046966 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1f41865a-0edd-4a8d-98ec-d00c502e58c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:03.055595 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 383/742] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:02 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:03.055797 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1f41865a-0edd-4a8d-98ec-d00c502e58c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.174314 Jul 22 22:18:03.055797 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 360/743] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:02 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:18:03.056014 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f4554710-90c9-406a-a8d4-fa5b8559d8dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:03.056014 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f4554710-90c9-406a-a8d4-fa5b8559d8dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:03.060051 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f4554710-90c9-406a-a8d4-fa5b8559d8dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:03.060534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f4554710-90c9-406a-a8d4-fa5b8559d8dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:03.061325 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f4554710-90c9-406a-a8d4-fa5b8559d8dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:03.061756 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f4554710-90c9-406a-a8d4-fa5b8559d8dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:03.145596 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-175db6a0-0f5b-417f-83e2-d3648775894b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:03.146308 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-175db6a0-0f5b-417f-83e2-d3648775894b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:03.152365 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-175db6a0-0f5b-417f-83e2-d3648775894b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:03.152815 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-175db6a0-0f5b-417f-83e2-d3648775894b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:03.153616 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-175db6a0-0f5b-417f-83e2-d3648775894b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:03.154067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-175db6a0-0f5b-417f-83e2-d3648775894b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:03.241937 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f4554710-90c9-406a-a8d4-fa5b8559d8dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:03.249992 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f4554710-90c9-406a-a8d4-fa5b8559d8dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.201521 Jul 22 22:18:03.260774 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 384/744] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:03 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:03.307434 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-175db6a0-0f5b-417f-83e2-d3648775894b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:03.316131 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-175db6a0-0f5b-417f-83e2-d3648775894b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.174466 Jul 22 22:18:03.316752 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 361/745] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:03 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:03.743190 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-8972b873-0b54-48e7-a375-a7c620fa0dde req-61037ce7-450d-4bac-bd33-faac86cf2395 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d6bddb6-47da-429e-9c5d-d9e1d50b4245", "name": "network-vif-deleted", "tag": "30112f59-0c99-4523-9a13-983baff94680"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:18:03.744849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:18:03.744849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:18:03.752989 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-8972b873-0b54-48e7-a375-a7c620fa0dde req-61037ce7-450d-4bac-bd33-faac86cf2395 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:03.753429 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-8972b873-0b54-48e7-a375-a7c620fa0dde req-61037ce7-450d-4bac-bd33-faac86cf2395 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:03.765224 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-8972b873-0b54-48e7-a375-a7c620fa0dde req-61037ce7-450d-4bac-bd33-faac86cf2395 service nova] Creating event network-vif-deleted:30112f59-0c99-4523-9a13-983baff94680 for instance 4d6bddb6-47da-429e-9c5d-d9e1d50b4245 on hv-cinder-80186 Jul 22 22:18:03.770526 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-8972b873-0b54-48e7-a375-a7c620fa0dde req-61037ce7-450d-4bac-bd33-faac86cf2395 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030761 Jul 22 22:18:03.771296 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 385/746] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:18:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:18:04.064898 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-80237992-da5f-4339-acc6-81f12c13551b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:04.065675 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-80237992-da5f-4339-acc6-81f12c13551b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:04.070431 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-485176d0-e110-4133-a197-8037be5a2886 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:04.071348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-485176d0-e110-4133-a197-8037be5a2886 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:04.072924 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-80237992-da5f-4339-acc6-81f12c13551b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:04.073364 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-80237992-da5f-4339-acc6-81f12c13551b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:04.074755 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-80237992-da5f-4339-acc6-81f12c13551b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:04.075186 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-80237992-da5f-4339-acc6-81f12c13551b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:04.080369 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-485176d0-e110-4133-a197-8037be5a2886 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:04.080815 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-485176d0-e110-4133-a197-8037be5a2886 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:04.081600 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-485176d0-e110-4133-a197-8037be5a2886 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:04.082039 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-485176d0-e110-4133-a197-8037be5a2886 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:04.110873 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-80237992-da5f-4339-acc6-81f12c13551b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:04.111311 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-80237992-da5f-4339-acc6-81f12c13551b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:04.111759 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.objects.instance [None req-80237992-da5f-4339-acc6-81f12c13551b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lazy-loading 'fault' on Instance uuid 4d6bddb6-47da-429e-9c5d-d9e1d50b4245 {{(pid=107498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:18:04.160654 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-80237992-da5f-4339-acc6-81f12c13551b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7438b1d834bd4e5f91ae4169e6b3a543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71bffb8e6c93437cb3fdbc82d8300750', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:04.169013 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-80237992-da5f-4339-acc6-81f12c13551b tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 200 len: 1312 microversion: 2.1 time: 0.108044 Jul 22 22:18:04.169430 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 362/747] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:04 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:04.231684 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-485176d0-e110-4133-a197-8037be5a2886 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:04.240156 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-485176d0-e110-4133-a197-8037be5a2886 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:04.241693 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-485176d0-e110-4133-a197-8037be5a2886 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:04.242821 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-485176d0-e110-4133-a197-8037be5a2886 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.179018 Jul 22 22:18:04.243376 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 386/748] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:04 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:18:04.268079 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b4748a08-d2e4-442d-85b4-fe3e6c5a4a6e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:04.268629 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b4748a08-d2e4-442d-85b4-fe3e6c5a4a6e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:04.274758 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4748a08-d2e4-442d-85b4-fe3e6c5a4a6e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:04.275210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4748a08-d2e4-442d-85b4-fe3e6c5a4a6e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:04.276010 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4748a08-d2e4-442d-85b4-fe3e6c5a4a6e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:04.276498 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4748a08-d2e4-442d-85b4-fe3e6c5a4a6e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:04.334891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c68f7bba-7699-48b5-8aa4-b18f4bd288d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:04.335707 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c68f7bba-7699-48b5-8aa4-b18f4bd288d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:04.343856 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c68f7bba-7699-48b5-8aa4-b18f4bd288d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:04.344331 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c68f7bba-7699-48b5-8aa4-b18f4bd288d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:04.345423 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c68f7bba-7699-48b5-8aa4-b18f4bd288d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:04.345855 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c68f7bba-7699-48b5-8aa4-b18f4bd288d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:04.431634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b4748a08-d2e4-442d-85b4-fe3e6c5a4a6e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:04.441014 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b4748a08-d2e4-442d-85b4-fe3e6c5a4a6e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.176051 Jul 22 22:18:04.441408 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 363/749] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:04 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:04.514950 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c68f7bba-7699-48b5-8aa4-b18f4bd288d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:04.523918 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c68f7bba-7699-48b5-8aa4-b18f4bd288d0 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.192982 Jul 22 22:18:04.524671 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 387/750] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:04 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:05.186682 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7a0bcb3b-acc3-46ff-97c7-65f14008a3fd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:05.187314 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7a0bcb3b-acc3-46ff-97c7-65f14008a3fd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] [instance: 4d6bddb6-47da-429e-9c5d-d9e1d50b4245] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:05.193302 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a0bcb3b-acc3-46ff-97c7-65f14008a3fd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.193769 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a0bcb3b-acc3-46ff-97c7-65f14008a3fd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.194532 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a0bcb3b-acc3-46ff-97c7-65f14008a3fd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.194965 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7a0bcb3b-acc3-46ff-97c7-65f14008a3fd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.210087 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-7a0bcb3b-acc3-46ff-97c7-65f14008a3fd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] HTTP exception thrown: Instance 4d6bddb6-47da-429e-9c5d-d9e1d50b4245 could not be found. Jul 22 22:18:05.210765 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7a0bcb3b-acc3-46ff-97c7-65f14008a3fd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] Returning 404 to user: Instance 4d6bddb6-47da-429e-9c5d-d9e1d50b4245 could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:18:05.211714 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7a0bcb3b-acc3-46ff-97c7-65f14008a3fd tempest-AttachVolumeNegativeTest-1407234141 tempest-AttachVolumeNegativeTest-1407234141-project] 10.222.0.110 "GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245" status: 404 len: 111 microversion: 2.1 time: 0.029759 Jul 22 22:18:05.212380 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 364/751] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:05 2021] GET /compute/v2.1/servers/4d6bddb6-47da-429e-9c5d-d9e1d50b4245 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 22:18:05.261300 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-10cecf80-5f87-4e0c-8eb3-1adca65542b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:05.262249 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-10cecf80-5f87-4e0c-8eb3-1adca65542b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:05.268173 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10cecf80-5f87-4e0c-8eb3-1adca65542b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.268654 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10cecf80-5f87-4e0c-8eb3-1adca65542b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.269433 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10cecf80-5f87-4e0c-8eb3-1adca65542b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.269866 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-10cecf80-5f87-4e0c-8eb3-1adca65542b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.465987 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c6348465-c338-46bd-860f-5086e4235d0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:05.466740 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c6348465-c338-46bd-860f-5086e4235d0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:05.477012 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c6348465-c338-46bd-860f-5086e4235d0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.477924 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c6348465-c338-46bd-860f-5086e4235d0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.478390 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c6348465-c338-46bd-860f-5086e4235d0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.478932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c6348465-c338-46bd-860f-5086e4235d0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.502150 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-10cecf80-5f87-4e0c-8eb3-1adca65542b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:05.516187 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-10cecf80-5f87-4e0c-8eb3-1adca65542b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:05.517846 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-10cecf80-5f87-4e0c-8eb3-1adca65542b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:05.519088 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-10cecf80-5f87-4e0c-8eb3-1adca65542b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.261565 Jul 22 22:18:05.519739 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 388/752] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:05 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:18:05.546246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7d109459-9171-4744-998a-6f3bfa28d75f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:05.546979 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7d109459-9171-4744-998a-6f3bfa28d75f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:05.553385 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d109459-9171-4744-998a-6f3bfa28d75f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.554079 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d109459-9171-4744-998a-6f3bfa28d75f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.554953 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d109459-9171-4744-998a-6f3bfa28d75f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.555470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d109459-9171-4744-998a-6f3bfa28d75f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.658027 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c6348465-c338-46bd-860f-5086e4235d0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:05.672257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c6348465-c338-46bd-860f-5086e4235d0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1506 microversion: 2.1 time: 0.210372 Jul 22 22:18:05.673249 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 365/753] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:05 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:05.701457 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6117755a-a311-40e1-bf17-cf7ceb9e2af8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8224aa4c-3669-4d24-afc6-80e242de5678"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:18:05.703263 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6117755a-a311-40e1-bf17-cf7ceb9e2af8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:05.713723 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6117755a-a311-40e1-bf17-cf7ceb9e2af8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.714519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6117755a-a311-40e1-bf17-cf7ceb9e2af8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.716478 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6117755a-a311-40e1-bf17-cf7ceb9e2af8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.717241 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6117755a-a311-40e1-bf17-cf7ceb9e2af8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.760982 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-6117755a-a311-40e1-bf17-cf7ceb9e2af8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] HTTP exception thrown: Cannot 'attach_volume' instance c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae while it is in vm_state rescued Jul 22 22:18:05.762168 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6117755a-a311-40e1-bf17-cf7ceb9e2af8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Returning 409 to user: Cannot 'attach_volume' instance c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae while it is in vm_state rescued {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:18:05.763726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6117755a-a311-40e1-bf17-cf7ceb9e2af8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069328 Jul 22 22:18:05.769036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 366/754] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:18:05 2021] POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 22 22:18:05.777081 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-eca41402-43f5-4244-8abb-b26738c650e0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:18:05.779253 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-eca41402-43f5-4244-8abb-b26738c650e0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:05.788223 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eca41402-43f5-4244-8abb-b26738c650e0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.788977 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eca41402-43f5-4244-8abb-b26738c650e0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.790303 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eca41402-43f5-4244-8abb-b26738c650e0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.790921 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eca41402-43f5-4244-8abb-b26738c650e0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.868833 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7d109459-9171-4744-998a-6f3bfa28d75f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:05.883961 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7d109459-9171-4744-998a-6f3bfa28d75f tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.343098 Jul 22 22:18:05.884327 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-eca41402-43f5-4244-8abb-b26738c650e0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/action" status: 202 len: 0 microversion: 2.1 time: 0.112855 Jul 22 22:18:05.889426 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 367/755] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:18:05 2021] POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:18:05.890669 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 389/756] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:05 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:05.901892 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4f90aa11-cf92-432b-895e-2aa1125b4aae tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:05.903869 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4f90aa11-cf92-432b-895e-2aa1125b4aae tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:05.915411 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f90aa11-cf92-432b-895e-2aa1125b4aae tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.916240 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f90aa11-cf92-432b-895e-2aa1125b4aae tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:05.917745 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f90aa11-cf92-432b-895e-2aa1125b4aae tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:05.919122 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f90aa11-cf92-432b-895e-2aa1125b4aae tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:06.126917 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4f90aa11-cf92-432b-895e-2aa1125b4aae tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:06.141997 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4f90aa11-cf92-432b-895e-2aa1125b4aae tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1514 microversion: 2.1 time: 0.248010 Jul 22 22:18:06.143634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 368/757] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:05 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:06.541873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f03186f3-641a-46f0-aa15-48681c22fd60 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:06.542537 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f03186f3-641a-46f0-aa15-48681c22fd60 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:06.550271 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f03186f3-641a-46f0-aa15-48681c22fd60 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:06.550725 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f03186f3-641a-46f0-aa15-48681c22fd60 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:06.551763 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f03186f3-641a-46f0-aa15-48681c22fd60 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:06.552450 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f03186f3-641a-46f0-aa15-48681c22fd60 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:06.797469 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f03186f3-641a-46f0-aa15-48681c22fd60 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:06.809770 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f03186f3-641a-46f0-aa15-48681c22fd60 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:06.811277 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f03186f3-641a-46f0-aa15-48681c22fd60 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:06.812472 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f03186f3-641a-46f0-aa15-48681c22fd60 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.277502 Jul 22 22:18:06.813126 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 390/758] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:06 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:18:06.914491 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8bf38680-3ae1-41d0-bfed-573ec438dfe5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:06.915272 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8bf38680-3ae1-41d0-bfed-573ec438dfe5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:06.922675 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8bf38680-3ae1-41d0-bfed-573ec438dfe5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:06.923197 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8bf38680-3ae1-41d0-bfed-573ec438dfe5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:06.924141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8bf38680-3ae1-41d0-bfed-573ec438dfe5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:06.924670 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8bf38680-3ae1-41d0-bfed-573ec438dfe5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:07.141382 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8bf38680-3ae1-41d0-bfed-573ec438dfe5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:07.157281 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8bf38680-3ae1-41d0-bfed-573ec438dfe5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.247554 Jul 22 22:18:07.158443 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 369/759] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:06 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:07.175794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-26453d8c-b0a6-4665-98c7-14cb5d85ca97 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:07.176347 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-26453d8c-b0a6-4665-98c7-14cb5d85ca97 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:07.183100 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-26453d8c-b0a6-4665-98c7-14cb5d85ca97 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:07.183544 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-26453d8c-b0a6-4665-98c7-14cb5d85ca97 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:07.185009 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-26453d8c-b0a6-4665-98c7-14cb5d85ca97 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:07.185456 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-26453d8c-b0a6-4665-98c7-14cb5d85ca97 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:07.345753 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-26453d8c-b0a6-4665-98c7-14cb5d85ca97 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:07.353890 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-26453d8c-b0a6-4665-98c7-14cb5d85ca97 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1514 microversion: 2.1 time: 0.194458 Jul 22 22:18:07.354627 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 391/760] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:07 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:07.842188 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8b0be761-b7e3-466d-9133-d618055274c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:07.843266 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8b0be761-b7e3-466d-9133-d618055274c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:07.852955 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b0be761-b7e3-466d-9133-d618055274c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:07.853706 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b0be761-b7e3-466d-9133-d618055274c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:07.855031 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b0be761-b7e3-466d-9133-d618055274c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:07.856138 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8b0be761-b7e3-466d-9133-d618055274c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:08.022651 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8b0be761-b7e3-466d-9133-d618055274c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:08.033855 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8b0be761-b7e3-466d-9133-d618055274c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:08.035502 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8b0be761-b7e3-466d-9133-d618055274c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:08.036702 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8b0be761-b7e3-466d-9133-d618055274c8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.201574 Jul 22 22:18:08.037258 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 370/761] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:07 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:18:08.184077 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-dea47f45-014a-4066-9bb5-2db77cd6538c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:08.185107 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-dea47f45-014a-4066-9bb5-2db77cd6538c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:08.193847 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dea47f45-014a-4066-9bb5-2db77cd6538c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:08.194296 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dea47f45-014a-4066-9bb5-2db77cd6538c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:08.195083 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dea47f45-014a-4066-9bb5-2db77cd6538c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:08.195531 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dea47f45-014a-4066-9bb5-2db77cd6538c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:08.373726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-552b3609-3399-4e34-8f9d-ee67989ab428 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:08.374945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-552b3609-3399-4e34-8f9d-ee67989ab428 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:08.383216 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-552b3609-3399-4e34-8f9d-ee67989ab428 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:08.384844 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-552b3609-3399-4e34-8f9d-ee67989ab428 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:08.386451 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-552b3609-3399-4e34-8f9d-ee67989ab428 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:08.388012 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-552b3609-3399-4e34-8f9d-ee67989ab428 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:08.404137 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-dea47f45-014a-4066-9bb5-2db77cd6538c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:08.420829 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-dea47f45-014a-4066-9bb5-2db77cd6538c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.242284 Jul 22 22:18:08.422242 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 392/762] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:08 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:08.616809 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-552b3609-3399-4e34-8f9d-ee67989ab428 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:08.628915 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-552b3609-3399-4e34-8f9d-ee67989ab428 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1514 microversion: 2.1 time: 0.260167 Jul 22 22:18:08.629665 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 371/763] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:08 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:09.056670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1c83dcbb-a565-4c6c-850d-5c962bd186ac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:09.057222 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1c83dcbb-a565-4c6c-850d-5c962bd186ac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:09.066732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1c83dcbb-a565-4c6c-850d-5c962bd186ac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:09.067791 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1c83dcbb-a565-4c6c-850d-5c962bd186ac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:09.069687 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1c83dcbb-a565-4c6c-850d-5c962bd186ac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:09.070819 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1c83dcbb-a565-4c6c-850d-5c962bd186ac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:09.221728 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1c83dcbb-a565-4c6c-850d-5c962bd186ac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:09.231065 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1c83dcbb-a565-4c6c-850d-5c962bd186ac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:09.232759 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1c83dcbb-a565-4c6c-850d-5c962bd186ac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:09.234292 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1c83dcbb-a565-4c6c-850d-5c962bd186ac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.181601 Jul 22 22:18:09.234969 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 393/764] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:09 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:18:09.439750 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ab6c253c-302b-4c05-a912-2b24ecd48365 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:09.442117 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ab6c253c-302b-4c05-a912-2b24ecd48365 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:09.448656 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab6c253c-302b-4c05-a912-2b24ecd48365 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:09.449129 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab6c253c-302b-4c05-a912-2b24ecd48365 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:09.449945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab6c253c-302b-4c05-a912-2b24ecd48365 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:09.450515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab6c253c-302b-4c05-a912-2b24ecd48365 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:09.609191 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ab6c253c-302b-4c05-a912-2b24ecd48365 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:09.619746 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ab6c253c-302b-4c05-a912-2b24ecd48365 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.183597 Jul 22 22:18:09.620367 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 372/765] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:09 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:09.646947 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-dde3f1d7-aaaf-476e-998c-79a94e799880 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:09.647549 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-dde3f1d7-aaaf-476e-998c-79a94e799880 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:09.654668 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dde3f1d7-aaaf-476e-998c-79a94e799880 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:09.655373 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dde3f1d7-aaaf-476e-998c-79a94e799880 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:09.656844 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dde3f1d7-aaaf-476e-998c-79a94e799880 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:09.657419 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dde3f1d7-aaaf-476e-998c-79a94e799880 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:09.828443 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-dde3f1d7-aaaf-476e-998c-79a94e799880 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:09.840387 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-dde3f1d7-aaaf-476e-998c-79a94e799880 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1514 microversion: 2.1 time: 0.196641 Jul 22 22:18:09.841883 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 394/766] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:09 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:10.252964 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e4364599-789b-4f46-99f1-08bc0505863a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:10.253484 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e4364599-789b-4f46-99f1-08bc0505863a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:10.259802 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e4364599-789b-4f46-99f1-08bc0505863a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:10.260256 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e4364599-789b-4f46-99f1-08bc0505863a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:10.261070 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e4364599-789b-4f46-99f1-08bc0505863a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:10.261519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e4364599-789b-4f46-99f1-08bc0505863a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:10.409380 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e4364599-789b-4f46-99f1-08bc0505863a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:10.419142 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e4364599-789b-4f46-99f1-08bc0505863a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:10.420717 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e4364599-789b-4f46-99f1-08bc0505863a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:10.421878 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e4364599-789b-4f46-99f1-08bc0505863a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.172955 Jul 22 22:18:10.422434 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 373/767] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:10 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:18:10.638383 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d549bca2-3d0a-475d-96df-f22c8c2a0e6c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:10.639041 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d549bca2-3d0a-475d-96df-f22c8c2a0e6c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:10.645479 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d549bca2-3d0a-475d-96df-f22c8c2a0e6c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:10.645931 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d549bca2-3d0a-475d-96df-f22c8c2a0e6c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:10.647404 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d549bca2-3d0a-475d-96df-f22c8c2a0e6c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:10.647874 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d549bca2-3d0a-475d-96df-f22c8c2a0e6c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:10.821244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d549bca2-3d0a-475d-96df-f22c8c2a0e6c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:10.830659 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d549bca2-3d0a-475d-96df-f22c8c2a0e6c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.196811 Jul 22 22:18:10.831243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 395/768] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:10 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:10.858897 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7673833e-0b7b-4577-b78e-5270bda5debe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:10.859625 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7673833e-0b7b-4577-b78e-5270bda5debe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:10.865744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7673833e-0b7b-4577-b78e-5270bda5debe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:10.866191 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7673833e-0b7b-4577-b78e-5270bda5debe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:10.866967 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7673833e-0b7b-4577-b78e-5270bda5debe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:10.867400 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7673833e-0b7b-4577-b78e-5270bda5debe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:11.263834 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7673833e-0b7b-4577-b78e-5270bda5debe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:11.273816 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7673833e-0b7b-4577-b78e-5270bda5debe tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1520 microversion: 2.1 time: 0.418699 Jul 22 22:18:11.274433 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 374/769] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:10 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1520 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:11.440804 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ded01712-aaa1-46be-a716-bffa2fe10776 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:11.441451 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ded01712-aaa1-46be-a716-bffa2fe10776 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:11.448151 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ded01712-aaa1-46be-a716-bffa2fe10776 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:11.448546 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ded01712-aaa1-46be-a716-bffa2fe10776 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:11.449737 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ded01712-aaa1-46be-a716-bffa2fe10776 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:11.450012 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ded01712-aaa1-46be-a716-bffa2fe10776 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:11.627991 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ded01712-aaa1-46be-a716-bffa2fe10776 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:11.639497 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ded01712-aaa1-46be-a716-bffa2fe10776 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:11.642129 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ded01712-aaa1-46be-a716-bffa2fe10776 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:11.644020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ded01712-aaa1-46be-a716-bffa2fe10776 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.206795 Jul 22 22:18:11.644857 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 396/770] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:11 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:18:11.849134 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ff9ca21f-902d-4e5d-bd77-45017ef13911 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:11.849701 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ff9ca21f-902d-4e5d-bd77-45017ef13911 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:11.856993 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ff9ca21f-902d-4e5d-bd77-45017ef13911 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:11.857437 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ff9ca21f-902d-4e5d-bd77-45017ef13911 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:11.858402 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ff9ca21f-902d-4e5d-bd77-45017ef13911 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:11.858890 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ff9ca21f-902d-4e5d-bd77-45017ef13911 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:12.023015 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ff9ca21f-902d-4e5d-bd77-45017ef13911 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:12.039928 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ff9ca21f-902d-4e5d-bd77-45017ef13911 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.194055 Jul 22 22:18:12.041120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 375/771] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:11 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:12.486074 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-5a61e019-3741-4707-8b40-ac9961c99146 req-429fad09-0165-46a6-b5c7-e8f7e7c47abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e7dd91-3f55-48c9-85aa-84c2450719f2", "name": "network-vif-plugged", "status": "completed", "tag": "e63aa00d-561e-478c-ad51-2858e1d33423"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:18:12.487932 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:18:12.487932 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:18:12.497307 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-5a61e019-3741-4707-8b40-ac9961c99146 req-429fad09-0165-46a6-b5c7-e8f7e7c47abc service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:12.498082 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-5a61e019-3741-4707-8b40-ac9961c99146 req-429fad09-0165-46a6-b5c7-e8f7e7c47abc service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:12.511025 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-5a61e019-3741-4707-8b40-ac9961c99146 req-429fad09-0165-46a6-b5c7-e8f7e7c47abc service nova] Creating event network-vif-plugged:e63aa00d-561e-478c-ad51-2858e1d33423 for instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 on hv-cinder-80186 Jul 22 22:18:12.517087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-5a61e019-3741-4707-8b40-ac9961c99146 req-429fad09-0165-46a6-b5c7-e8f7e7c47abc service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035098 Jul 22 22:18:12.518032 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 397/772] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:18:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:18:12.662934 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9f63e855-250e-4987-a21e-69771f688aa5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:12.663619 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9f63e855-250e-4987-a21e-69771f688aa5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:12.671462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9f63e855-250e-4987-a21e-69771f688aa5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:12.672021 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9f63e855-250e-4987-a21e-69771f688aa5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:12.672944 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9f63e855-250e-4987-a21e-69771f688aa5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:12.673447 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9f63e855-250e-4987-a21e-69771f688aa5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:12.708502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8f682766-c936-4d62-a4a0-d2c1a98d8bdf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:12.709430 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8f682766-c936-4d62-a4a0-d2c1a98d8bdf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:12.717815 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f682766-c936-4d62-a4a0-d2c1a98d8bdf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:12.718407 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f682766-c936-4d62-a4a0-d2c1a98d8bdf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:12.719811 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f682766-c936-4d62-a4a0-d2c1a98d8bdf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:12.720435 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f682766-c936-4d62-a4a0-d2c1a98d8bdf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:12.835853 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9f63e855-250e-4987-a21e-69771f688aa5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:12.845240 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9f63e855-250e-4987-a21e-69771f688aa5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:12.846757 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9f63e855-250e-4987-a21e-69771f688aa5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:12.847923 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9f63e855-250e-4987-a21e-69771f688aa5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.188879 Jul 22 22:18:12.848688 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 376/773] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:12 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:18:12.916383 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8f682766-c936-4d62-a4a0-d2c1a98d8bdf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:12.925566 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8f682766-c936-4d62-a4a0-d2c1a98d8bdf tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1520 microversion: 2.1 time: 0.222395 Jul 22 22:18:12.926401 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 398/774] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:12 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:12.942727 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fd604e1a-b8ea-4022-86b6-f641b8d33a74 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eaf9284e-fb77-4265-8628-8b5de92d43a1"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:18:12.943923 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fd604e1a-b8ea-4022-86b6-f641b8d33a74 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:12.952090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fd604e1a-b8ea-4022-86b6-f641b8d33a74 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:12.952567 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fd604e1a-b8ea-4022-86b6-f641b8d33a74 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:12.953358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fd604e1a-b8ea-4022-86b6-f641b8d33a74 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:12.953789 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fd604e1a-b8ea-4022-86b6-f641b8d33a74 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:13.065868 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d6349f71-2259-43a3-95a0-3a160291f1be tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:13.066470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d6349f71-2259-43a3-95a0-3a160291f1be tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:13.073300 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d6349f71-2259-43a3-95a0-3a160291f1be tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:13.073752 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d6349f71-2259-43a3-95a0-3a160291f1be tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:13.075706 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d6349f71-2259-43a3-95a0-3a160291f1be tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:13.076148 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d6349f71-2259-43a3-95a0-3a160291f1be tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:13.249018 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d6349f71-2259-43a3-95a0-3a160291f1be tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:13.258323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d6349f71-2259-43a3-95a0-3a160291f1be tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.196007 Jul 22 22:18:13.258918 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 399/775] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:13 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:13.866970 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b4281aa6-7fbe-4226-bea7-031def0a67d8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:13.867639 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b4281aa6-7fbe-4226-bea7-031def0a67d8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:13.875908 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b4281aa6-7fbe-4226-bea7-031def0a67d8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:13.876389 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b4281aa6-7fbe-4226-bea7-031def0a67d8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:13.877181 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b4281aa6-7fbe-4226-bea7-031def0a67d8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:13.877614 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b4281aa6-7fbe-4226-bea7-031def0a67d8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:14.037663 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b4281aa6-7fbe-4226-bea7-031def0a67d8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:14.047613 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b4281aa6-7fbe-4226-bea7-031def0a67d8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:14.049159 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b4281aa6-7fbe-4226-bea7-031def0a67d8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:14.050336 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b4281aa6-7fbe-4226-bea7-031def0a67d8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.187085 Jul 22 22:18:14.050898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 400/776] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:13 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:18:14.276352 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d2379bee-5081-49e4-a94f-a440966eb98e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:14.277940 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d2379bee-5081-49e4-a94f-a440966eb98e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:14.285202 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d2379bee-5081-49e4-a94f-a440966eb98e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:14.285724 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d2379bee-5081-49e4-a94f-a440966eb98e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:14.286555 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d2379bee-5081-49e4-a94f-a440966eb98e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:14.287071 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d2379bee-5081-49e4-a94f-a440966eb98e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:14.449214 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d2379bee-5081-49e4-a94f-a440966eb98e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:14.458579 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d2379bee-5081-49e4-a94f-a440966eb98e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.185827 Jul 22 22:18:14.459162 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 401/777] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:14 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:15.070833 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f43a44b5-a293-44fe-b1f9-f5cfe68915ba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:15.071669 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f43a44b5-a293-44fe-b1f9-f5cfe68915ba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:15.080104 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f43a44b5-a293-44fe-b1f9-f5cfe68915ba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:15.080683 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f43a44b5-a293-44fe-b1f9-f5cfe68915ba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:15.081677 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f43a44b5-a293-44fe-b1f9-f5cfe68915ba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:15.082237 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f43a44b5-a293-44fe-b1f9-f5cfe68915ba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:15.236805 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f43a44b5-a293-44fe-b1f9-f5cfe68915ba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:15.246499 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f43a44b5-a293-44fe-b1f9-f5cfe68915ba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:15.248252 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f43a44b5-a293-44fe-b1f9-f5cfe68915ba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:15.249463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f43a44b5-a293-44fe-b1f9-f5cfe68915ba tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.183807 Jul 22 22:18:15.250027 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 402/778] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:15 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:18:15.478551 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fda4b085-3c4a-4556-8925-4f6dea21e5fc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:15.479094 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fda4b085-3c4a-4556-8925-4f6dea21e5fc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:15.486676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fda4b085-3c4a-4556-8925-4f6dea21e5fc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:15.487125 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fda4b085-3c4a-4556-8925-4f6dea21e5fc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:15.487907 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fda4b085-3c4a-4556-8925-4f6dea21e5fc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:15.488377 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fda4b085-3c4a-4556-8925-4f6dea21e5fc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:15.641190 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fda4b085-3c4a-4556-8925-4f6dea21e5fc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:15.651154 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fda4b085-3c4a-4556-8925-4f6dea21e5fc tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.176001 Jul 22 22:18:15.652500 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 403/779] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:15 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:16.267430 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-026cb5c0-4fd5-40d9-be90-79f25f26a122 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:16.268369 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-026cb5c0-4fd5-40d9-be90-79f25f26a122 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:16.274405 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-026cb5c0-4fd5-40d9-be90-79f25f26a122 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:16.274885 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-026cb5c0-4fd5-40d9-be90-79f25f26a122 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:16.275722 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-026cb5c0-4fd5-40d9-be90-79f25f26a122 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:16.276158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-026cb5c0-4fd5-40d9-be90-79f25f26a122 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:16.428010 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-026cb5c0-4fd5-40d9-be90-79f25f26a122 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:16.437448 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-026cb5c0-4fd5-40d9-be90-79f25f26a122 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:16.438936 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-026cb5c0-4fd5-40d9-be90-79f25f26a122 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:16.440116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-026cb5c0-4fd5-40d9-be90-79f25f26a122 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.176600 Jul 22 22:18:16.440719 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 404/780] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:16 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:18:16.671361 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0654505a-fe81-4daa-85fb-2ff39fbdf61d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:16.672002 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0654505a-fe81-4daa-85fb-2ff39fbdf61d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:16.678526 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0654505a-fe81-4daa-85fb-2ff39fbdf61d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:16.678967 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0654505a-fe81-4daa-85fb-2ff39fbdf61d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:16.679731 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0654505a-fe81-4daa-85fb-2ff39fbdf61d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:16.680158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0654505a-fe81-4daa-85fb-2ff39fbdf61d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:16.860720 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0654505a-fe81-4daa-85fb-2ff39fbdf61d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:16.869054 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0654505a-fe81-4daa-85fb-2ff39fbdf61d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.202198 Jul 22 22:18:16.869634 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 405/781] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:16 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:17.413542 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fd604e1a-b8ea-4022-86b6-f641b8d33a74 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.474248 Jul 22 22:18:17.414383 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 377/782] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:18:12 2021] POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/os-volume_attachments => generated 194 bytes in 4476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:18:17.459425 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fd428edb-fdb3-4ef9-bcd5-dbb40b93a853 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:17.460760 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fd428edb-fdb3-4ef9-bcd5-dbb40b93a853 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:17.468000 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fd428edb-fdb3-4ef9-bcd5-dbb40b93a853 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:17.468487 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fd428edb-fdb3-4ef9-bcd5-dbb40b93a853 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:17.469541 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fd428edb-fdb3-4ef9-bcd5-dbb40b93a853 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:17.469975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fd428edb-fdb3-4ef9-bcd5-dbb40b93a853 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:17.688981 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fd428edb-fdb3-4ef9-bcd5-dbb40b93a853 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:17.697829 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fd428edb-fdb3-4ef9-bcd5-dbb40b93a853 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:17.699698 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fd428edb-fdb3-4ef9-bcd5-dbb40b93a853 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:17.700942 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fd428edb-fdb3-4ef9-bcd5-dbb40b93a853 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.245732 Jul 22 22:18:17.701620 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 406/783] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:17 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:18:17.891324 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e58df2bc-10a9-42a2-83e2-332e04614864 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:17.892025 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e58df2bc-10a9-42a2-83e2-332e04614864 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:17.898199 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e58df2bc-10a9-42a2-83e2-332e04614864 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:17.898643 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e58df2bc-10a9-42a2-83e2-332e04614864 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:17.899431 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e58df2bc-10a9-42a2-83e2-332e04614864 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:17.899866 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e58df2bc-10a9-42a2-83e2-332e04614864 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:18.048963 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e58df2bc-10a9-42a2-83e2-332e04614864 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:18.057582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e58df2bc-10a9-42a2-83e2-332e04614864 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.170257 Jul 22 22:18:18.058167 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 378/784] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:17 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:18.719726 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a7b8e91f-e197-4dbb-97c2-807f77af03b4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:18.720684 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a7b8e91f-e197-4dbb-97c2-807f77af03b4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:18.727025 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a7b8e91f-e197-4dbb-97c2-807f77af03b4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:18.727559 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a7b8e91f-e197-4dbb-97c2-807f77af03b4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:18.728513 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a7b8e91f-e197-4dbb-97c2-807f77af03b4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:18.729026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a7b8e91f-e197-4dbb-97c2-807f77af03b4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:18.908998 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a7b8e91f-e197-4dbb-97c2-807f77af03b4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:18.923377 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a7b8e91f-e197-4dbb-97c2-807f77af03b4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:18.927081 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a7b8e91f-e197-4dbb-97c2-807f77af03b4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:18.928079 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a7b8e91f-e197-4dbb-97c2-807f77af03b4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.212530 Jul 22 22:18:18.928892 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 407/785] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:18 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:18:19.076506 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bde0b66d-7d00-4e22-9f51-d0fcce3861b2 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:19.077608 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bde0b66d-7d00-4e22-9f51-d0fcce3861b2 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:19.084490 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bde0b66d-7d00-4e22-9f51-d0fcce3861b2 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:19.085050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bde0b66d-7d00-4e22-9f51-d0fcce3861b2 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:19.085849 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bde0b66d-7d00-4e22-9f51-d0fcce3861b2 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:19.086344 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bde0b66d-7d00-4e22-9f51-d0fcce3861b2 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:19.271710 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bde0b66d-7d00-4e22-9f51-d0fcce3861b2 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:19.283737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bde0b66d-7d00-4e22-9f51-d0fcce3861b2 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.211476 Jul 22 22:18:19.284454 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 379/786] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:19 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:19.947020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-342f870f-f5f8-45aa-9b79-38fe427eba3f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:19.947576 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-342f870f-f5f8-45aa-9b79-38fe427eba3f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:19.950796 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: ERROR oslo.messaging._drivers.impl_rabbit [-] [31c2f0c5-9786-4bfd-928f-a237671d36e1] AMQP server on 10.222.0.110:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 22 22:18:19.955364 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-342f870f-f5f8-45aa-9b79-38fe427eba3f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:19.955813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-342f870f-f5f8-45aa-9b79-38fe427eba3f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:19.956629 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-342f870f-f5f8-45aa-9b79-38fe427eba3f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:19.957121 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-342f870f-f5f8-45aa-9b79-38fe427eba3f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:20.095024 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-342f870f-f5f8-45aa-9b79-38fe427eba3f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:20.103293 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-342f870f-f5f8-45aa-9b79-38fe427eba3f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:20.105707 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-342f870f-f5f8-45aa-9b79-38fe427eba3f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:20.107186 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-342f870f-f5f8-45aa-9b79-38fe427eba3f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.164089 Jul 22 22:18:20.107764 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 408/787] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:19 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:18:20.302410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-31dd7599-1f6e-4a12-a135-80646e8073ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:20.303026 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-31dd7599-1f6e-4a12-a135-80646e8073ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:20.309344 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-31dd7599-1f6e-4a12-a135-80646e8073ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:20.309790 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-31dd7599-1f6e-4a12-a135-80646e8073ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:20.310569 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-31dd7599-1f6e-4a12-a135-80646e8073ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:20.311000 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-31dd7599-1f6e-4a12-a135-80646e8073ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:20.496995 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-31dd7599-1f6e-4a12-a135-80646e8073ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:20.512148 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-31dd7599-1f6e-4a12-a135-80646e8073ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.213192 Jul 22 22:18:20.512933 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 380/788] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:20 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:21.124258 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-59c8ab90-c4cc-4307-a408-0cf5df1ad951 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:21.124873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-59c8ab90-c4cc-4307-a408-0cf5df1ad951 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:21.143356 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-59c8ab90-c4cc-4307-a408-0cf5df1ad951 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:21.143789 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-59c8ab90-c4cc-4307-a408-0cf5df1ad951 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:21.144599 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-59c8ab90-c4cc-4307-a408-0cf5df1ad951 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:21.145030 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-59c8ab90-c4cc-4307-a408-0cf5df1ad951 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:21.150859 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO oslo.messaging._drivers.impl_rabbit [-] [31c2f0c5-9786-4bfd-928f-a237671d36e1] Reconnected to AMQP server on 10.222.0.110:5672 via [amqp] client with port 33202. Jul 22 22:18:21.297531 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-59c8ab90-c4cc-4307-a408-0cf5df1ad951 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:21.305915 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-59c8ab90-c4cc-4307-a408-0cf5df1ad951 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:21.307627 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-59c8ab90-c4cc-4307-a408-0cf5df1ad951 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:21.308862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-59c8ab90-c4cc-4307-a408-0cf5df1ad951 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1812 microversion: 2.20 time: 0.188336 Jul 22 22:18:21.309497 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 409/789] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:21 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1812 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:18:21.530287 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b4e8b718-4d65-4752-8a36-6ae2d77960b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:21.530835 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b4e8b718-4d65-4752-8a36-6ae2d77960b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:21.537256 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4e8b718-4d65-4752-8a36-6ae2d77960b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:21.537726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4e8b718-4d65-4752-8a36-6ae2d77960b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:21.538554 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4e8b718-4d65-4752-8a36-6ae2d77960b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:21.538983 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4e8b718-4d65-4752-8a36-6ae2d77960b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:21.689658 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b4e8b718-4d65-4752-8a36-6ae2d77960b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:21.697578 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b4e8b718-4d65-4752-8a36-6ae2d77960b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.171646 Jul 22 22:18:21.698135 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 381/790] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:21 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:22.327344 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a1c13a55-bd41-4486-b474-d102923e7048 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:22.327931 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a1c13a55-bd41-4486-b474-d102923e7048 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:22.333919 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a1c13a55-bd41-4486-b474-d102923e7048 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:22.334355 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a1c13a55-bd41-4486-b474-d102923e7048 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:22.335114 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a1c13a55-bd41-4486-b474-d102923e7048 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:22.335554 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a1c13a55-bd41-4486-b474-d102923e7048 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:22.483458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a1c13a55-bd41-4486-b474-d102923e7048 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:22.494243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a1c13a55-bd41-4486-b474-d102923e7048 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:22.496101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a1c13a55-bd41-4486-b474-d102923e7048 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:22.497462 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a1c13a55-bd41-4486-b474-d102923e7048 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1799 microversion: 2.20 time: 0.173700 Jul 22 22:18:22.498106 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 410/791] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:18:22 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1799 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:18:22.715735 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0e780dfc-d4b4-4c7c-b4ac-2a4e77591f1b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:22.719036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0e780dfc-d4b4-4c7c-b4ac-2a4e77591f1b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:22.725634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0e780dfc-d4b4-4c7c-b4ac-2a4e77591f1b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:22.726076 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0e780dfc-d4b4-4c7c-b4ac-2a4e77591f1b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:22.726842 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0e780dfc-d4b4-4c7c-b4ac-2a4e77591f1b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:22.727271 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0e780dfc-d4b4-4c7c-b4ac-2a4e77591f1b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:22.884532 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0e780dfc-d4b4-4c7c-b4ac-2a4e77591f1b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:22.893320 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0e780dfc-d4b4-4c7c-b4ac-2a4e77591f1b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.182258 Jul 22 22:18:22.893880 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 382/792] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:22 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:23.911006 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b2e396c4-5361-424e-b79d-7e6141a0b75b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:23.911598 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b2e396c4-5361-424e-b79d-7e6141a0b75b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:23.918250 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2e396c4-5361-424e-b79d-7e6141a0b75b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:23.918689 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2e396c4-5361-424e-b79d-7e6141a0b75b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:23.919503 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2e396c4-5361-424e-b79d-7e6141a0b75b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:23.919970 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2e396c4-5361-424e-b79d-7e6141a0b75b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:24.067527 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b2e396c4-5361-424e-b79d-7e6141a0b75b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:24.075768 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b2e396c4-5361-424e-b79d-7e6141a0b75b tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.168290 Jul 22 22:18:24.076371 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 411/793] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:23 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:25.093082 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2d26c74b-7828-420b-8535-d5bb0e819574 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:25.093955 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2d26c74b-7828-420b-8535-d5bb0e819574 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:25.099926 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2d26c74b-7828-420b-8535-d5bb0e819574 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:25.100404 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2d26c74b-7828-420b-8535-d5bb0e819574 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:25.101174 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2d26c74b-7828-420b-8535-d5bb0e819574 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:25.101612 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2d26c74b-7828-420b-8535-d5bb0e819574 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:25.250022 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2d26c74b-7828-420b-8535-d5bb0e819574 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:25.257929 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2d26c74b-7828-420b-8535-d5bb0e819574 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.168538 Jul 22 22:18:25.258486 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 383/794] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:25 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:26.052031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8ddfccdc-ea3b-452e-8591-17f64406b6a1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:18:26.053067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8ddfccdc-ea3b-452e-8591-17f64406b6a1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:26.058992 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8ddfccdc-ea3b-452e-8591-17f64406b6a1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:26.059443 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8ddfccdc-ea3b-452e-8591-17f64406b6a1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:26.060199 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8ddfccdc-ea3b-452e-8591-17f64406b6a1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:26.060663 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8ddfccdc-ea3b-452e-8591-17f64406b6a1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:26.083080 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-8ddfccdc-ea3b-452e-8591-17f64406b6a1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lazy-loading 'flavor' on Instance uuid c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:18:26.210290 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8ddfccdc-ea3b-452e-8591-17f64406b6a1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/action" status: 200 len: 32 microversion: 2.1 time: 0.161964 Jul 22 22:18:26.210892 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 412/795] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:18:26 2021] POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:18:26.220497 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cc4d6b4a-17ba-48cd-8b42-4aac5e0dc808 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:26.221112 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cc4d6b4a-17ba-48cd-8b42-4aac5e0dc808 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:26.227418 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc4d6b4a-17ba-48cd-8b42-4aac5e0dc808 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:26.227892 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc4d6b4a-17ba-48cd-8b42-4aac5e0dc808 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:26.228704 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc4d6b4a-17ba-48cd-8b42-4aac5e0dc808 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:26.229135 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc4d6b4a-17ba-48cd-8b42-4aac5e0dc808 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:26.275197 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5441a81e-20f4-4bff-b72b-429e33432f8d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:26.275892 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5441a81e-20f4-4bff-b72b-429e33432f8d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:26.283139 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5441a81e-20f4-4bff-b72b-429e33432f8d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:26.283587 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5441a81e-20f4-4bff-b72b-429e33432f8d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:26.284476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5441a81e-20f4-4bff-b72b-429e33432f8d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:26.284894 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5441a81e-20f4-4bff-b72b-429e33432f8d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:26.532134 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5441a81e-20f4-4bff-b72b-429e33432f8d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:26.540683 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5441a81e-20f4-4bff-b72b-429e33432f8d tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.269318 Jul 22 22:18:26.541271 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 413/796] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:26 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:26.547020 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cc4d6b4a-17ba-48cd-8b42-4aac5e0dc808 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:26.555271 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cc4d6b4a-17ba-48cd-8b42-4aac5e0dc808 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.338602 Jul 22 22:18:26.555854 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 384/797] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:26 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:27.558542 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8e608859-00f1-4439-9336-0ca3a16523fa tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:27.559137 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8e608859-00f1-4439-9336-0ca3a16523fa tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:27.565138 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8e608859-00f1-4439-9336-0ca3a16523fa tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:27.565572 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8e608859-00f1-4439-9336-0ca3a16523fa tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:27.566326 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8e608859-00f1-4439-9336-0ca3a16523fa tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:27.566776 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8e608859-00f1-4439-9336-0ca3a16523fa tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:27.572712 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6b20a9f4-14b3-472e-89a9-6894df1dcfd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:27.576791 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6b20a9f4-14b3-472e-89a9-6894df1dcfd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:27.583020 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6b20a9f4-14b3-472e-89a9-6894df1dcfd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:27.583481 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6b20a9f4-14b3-472e-89a9-6894df1dcfd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:27.584269 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6b20a9f4-14b3-472e-89a9-6894df1dcfd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:27.584732 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6b20a9f4-14b3-472e-89a9-6894df1dcfd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:27.722110 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8e608859-00f1-4439-9336-0ca3a16523fa tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:27.737844 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8e608859-00f1-4439-9336-0ca3a16523fa tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.182911 Jul 22 22:18:27.738741 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 414/798] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:27 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:27.748562 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6b20a9f4-14b3-472e-89a9-6894df1dcfd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:27.758415 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6b20a9f4-14b3-472e-89a9-6894df1dcfd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.189311 Jul 22 22:18:27.758976 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 385/799] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:27 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:28.761410 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4908dbdf-52a5-4f8f-bf57-02f8a5164aba tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:28.762271 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4908dbdf-52a5-4f8f-bf57-02f8a5164aba tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:28.767994 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4908dbdf-52a5-4f8f-bf57-02f8a5164aba tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:28.768484 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4908dbdf-52a5-4f8f-bf57-02f8a5164aba tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:28.769254 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4908dbdf-52a5-4f8f-bf57-02f8a5164aba tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:28.769773 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4908dbdf-52a5-4f8f-bf57-02f8a5164aba tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:28.783645 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2e41b970-bc78-4fc8-af9a-d8ca658e8fcc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:28.787138 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2e41b970-bc78-4fc8-af9a-d8ca658e8fcc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:28.795263 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2e41b970-bc78-4fc8-af9a-d8ca658e8fcc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:28.796188 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2e41b970-bc78-4fc8-af9a-d8ca658e8fcc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:28.797408 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2e41b970-bc78-4fc8-af9a-d8ca658e8fcc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:28.798065 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2e41b970-bc78-4fc8-af9a-d8ca658e8fcc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:28.969578 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2e41b970-bc78-4fc8-af9a-d8ca658e8fcc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:28.978473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2e41b970-bc78-4fc8-af9a-d8ca658e8fcc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.207269 Jul 22 22:18:28.979378 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 386/800] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:28 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:29.040199 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4908dbdf-52a5-4f8f-bf57-02f8a5164aba tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:29.048867 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4908dbdf-52a5-4f8f-bf57-02f8a5164aba tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1759 microversion: 2.1 time: 0.291609 Jul 22 22:18:29.049726 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 415/801] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:28 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1759 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:29.995789 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b4cf356b-07c4-49d2-af46-6affb1288793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:29.996473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b4cf356b-07c4-49d2-af46-6affb1288793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:30.002299 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4cf356b-07c4-49d2-af46-6affb1288793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:30.002980 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4cf356b-07c4-49d2-af46-6affb1288793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:30.003495 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4cf356b-07c4-49d2-af46-6affb1288793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:30.003949 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b4cf356b-07c4-49d2-af46-6affb1288793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:30.066336 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2380ba62-0950-40fa-9fae-f3bd12b87625 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:30.066945 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2380ba62-0950-40fa-9fae-f3bd12b87625 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:30.072784 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2380ba62-0950-40fa-9fae-f3bd12b87625 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:30.073776 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2380ba62-0950-40fa-9fae-f3bd12b87625 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:30.074725 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2380ba62-0950-40fa-9fae-f3bd12b87625 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:30.075160 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2380ba62-0950-40fa-9fae-f3bd12b87625 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:30.147620 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b4cf356b-07c4-49d2-af46-6affb1288793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:30.156030 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b4cf356b-07c4-49d2-af46-6affb1288793 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.164512 Jul 22 22:18:30.156735 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 387/802] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:29 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:30.214443 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2380ba62-0950-40fa-9fae-f3bd12b87625 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:30.222572 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2380ba62-0950-40fa-9fae-f3bd12b87625 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1762 microversion: 2.1 time: 0.159910 Jul 22 22:18:30.223139 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 416/803] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:30 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1762 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:31.172574 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f4044756-4a1d-4abe-900b-75a98828cc55 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:31.173193 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f4044756-4a1d-4abe-900b-75a98828cc55 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:31.179064 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f4044756-4a1d-4abe-900b-75a98828cc55 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:31.179504 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f4044756-4a1d-4abe-900b-75a98828cc55 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:31.180299 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f4044756-4a1d-4abe-900b-75a98828cc55 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:31.180723 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f4044756-4a1d-4abe-900b-75a98828cc55 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:31.317647 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f4044756-4a1d-4abe-900b-75a98828cc55 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:31.326481 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f4044756-4a1d-4abe-900b-75a98828cc55 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.157341 Jul 22 22:18:31.327053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 388/804] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:31 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:31.478461 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:18:31.478655 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: Thu Jul 22 22:18:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:18:32.343785 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b2b5c610-d6dc-4b86-9f85-09f90525d5e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:32.344413 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b2b5c610-d6dc-4b86-9f85-09f90525d5e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:32.350309 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2b5c610-d6dc-4b86-9f85-09f90525d5e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:32.350808 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2b5c610-d6dc-4b86-9f85-09f90525d5e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:32.351571 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2b5c610-d6dc-4b86-9f85-09f90525d5e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:32.352007 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2b5c610-d6dc-4b86-9f85-09f90525d5e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:32.494968 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b2b5c610-d6dc-4b86-9f85-09f90525d5e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:32.502810 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b2b5c610-d6dc-4b86-9f85-09f90525d5e9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.163712 Jul 22 22:18:32.503370 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 417/805] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:32 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:33.520936 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-867c83c9-1d09-4214-a62b-61233c85036a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:33.521495 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-867c83c9-1d09-4214-a62b-61233c85036a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:33.527618 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-867c83c9-1d09-4214-a62b-61233c85036a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:33.528063 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-867c83c9-1d09-4214-a62b-61233c85036a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:33.529673 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-867c83c9-1d09-4214-a62b-61233c85036a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:33.529851 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-867c83c9-1d09-4214-a62b-61233c85036a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:33.676393 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-867c83c9-1d09-4214-a62b-61233c85036a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:33.684057 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-867c83c9-1d09-4214-a62b-61233c85036a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.167469 Jul 22 22:18:33.684651 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 389/806] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:33 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:34.701667 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-cbf6648b-50ec-4fdd-a5f6-868dbdd0feb9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:34.702303 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-cbf6648b-50ec-4fdd-a5f6-868dbdd0feb9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:34.708243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cbf6648b-50ec-4fdd-a5f6-868dbdd0feb9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:34.708717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cbf6648b-50ec-4fdd-a5f6-868dbdd0feb9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:34.709486 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cbf6648b-50ec-4fdd-a5f6-868dbdd0feb9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:34.709922 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cbf6648b-50ec-4fdd-a5f6-868dbdd0feb9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:34.849086 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-cbf6648b-50ec-4fdd-a5f6-868dbdd0feb9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:34.857782 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-cbf6648b-50ec-4fdd-a5f6-868dbdd0feb9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.160107 Jul 22 22:18:34.858342 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 418/807] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:34 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:35.873716 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5c6b2366-7043-4c44-afb4-5035a63414aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:35.874313 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5c6b2366-7043-4c44-afb4-5035a63414aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:35.880786 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5c6b2366-7043-4c44-afb4-5035a63414aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:35.881227 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5c6b2366-7043-4c44-afb4-5035a63414aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:35.881990 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5c6b2366-7043-4c44-afb4-5035a63414aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:35.882418 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5c6b2366-7043-4c44-afb4-5035a63414aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:36.020843 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5c6b2366-7043-4c44-afb4-5035a63414aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:36.029240 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5c6b2366-7043-4c44-afb4-5035a63414aa tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.158565 Jul 22 22:18:36.029908 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 390/808] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:35 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:37.047972 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4da32006-82cf-4b5a-9fad-ca1423a48254 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:37.049099 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4da32006-82cf-4b5a-9fad-ca1423a48254 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:37.055890 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4da32006-82cf-4b5a-9fad-ca1423a48254 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:37.056370 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4da32006-82cf-4b5a-9fad-ca1423a48254 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:37.057137 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4da32006-82cf-4b5a-9fad-ca1423a48254 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:37.057568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4da32006-82cf-4b5a-9fad-ca1423a48254 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:37.200098 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4da32006-82cf-4b5a-9fad-ca1423a48254 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:37.208772 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4da32006-82cf-4b5a-9fad-ca1423a48254 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.165544 Jul 22 22:18:37.209340 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 419/809] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:37 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:38.226584 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b7355237-c8da-49de-86ca-e1420ffe9205 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:38.227189 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b7355237-c8da-49de-86ca-e1420ffe9205 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:38.233452 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b7355237-c8da-49de-86ca-e1420ffe9205 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:38.233902 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b7355237-c8da-49de-86ca-e1420ffe9205 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:38.234697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b7355237-c8da-49de-86ca-e1420ffe9205 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:38.235132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b7355237-c8da-49de-86ca-e1420ffe9205 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:38.375286 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b7355237-c8da-49de-86ca-e1420ffe9205 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:38.383195 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b7355237-c8da-49de-86ca-e1420ffe9205 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.160253 Jul 22 22:18:38.383737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 391/810] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:38 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:39.399181 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-23ad8784-5bbe-4d15-8755-3191448e4673 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:39.400025 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-23ad8784-5bbe-4d15-8755-3191448e4673 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:39.406373 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-23ad8784-5bbe-4d15-8755-3191448e4673 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:39.406812 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-23ad8784-5bbe-4d15-8755-3191448e4673 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:39.407591 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-23ad8784-5bbe-4d15-8755-3191448e4673 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:39.408024 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-23ad8784-5bbe-4d15-8755-3191448e4673 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:39.542970 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-23ad8784-5bbe-4d15-8755-3191448e4673 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:39.550739 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-23ad8784-5bbe-4d15-8755-3191448e4673 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.155182 Jul 22 22:18:39.551294 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 420/811] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:39 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:40.568533 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f83f2566-1f79-4270-8b57-46462962b3ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:40.569136 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f83f2566-1f79-4270-8b57-46462962b3ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:40.575010 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f83f2566-1f79-4270-8b57-46462962b3ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:40.576002 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f83f2566-1f79-4270-8b57-46462962b3ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:40.576798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f83f2566-1f79-4270-8b57-46462962b3ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:40.577235 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f83f2566-1f79-4270-8b57-46462962b3ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:40.715162 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f83f2566-1f79-4270-8b57-46462962b3ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:40.723422 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f83f2566-1f79-4270-8b57-46462962b3ad tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.158560 Jul 22 22:18:40.723990 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 392/812] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:40 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:41.740683 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a9773a6f-4ade-4674-8451-0d9be7d304c4 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:41.741308 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a9773a6f-4ade-4674-8451-0d9be7d304c4 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:41.747210 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9773a6f-4ade-4674-8451-0d9be7d304c4 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:41.747658 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9773a6f-4ade-4674-8451-0d9be7d304c4 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:41.748455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9773a6f-4ade-4674-8451-0d9be7d304c4 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:41.749206 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a9773a6f-4ade-4674-8451-0d9be7d304c4 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:41.885661 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a9773a6f-4ade-4674-8451-0d9be7d304c4 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:41.893850 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a9773a6f-4ade-4674-8451-0d9be7d304c4 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.156941 Jul 22 22:18:41.894421 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 421/813] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:41 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:42.910641 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-42a48e64-9c53-4574-b757-b3401d0d9535 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:42.911247 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-42a48e64-9c53-4574-b757-b3401d0d9535 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:42.917230 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a48e64-9c53-4574-b757-b3401d0d9535 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:42.917674 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a48e64-9c53-4574-b757-b3401d0d9535 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:42.918700 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a48e64-9c53-4574-b757-b3401d0d9535 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:42.919139 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-42a48e64-9c53-4574-b757-b3401d0d9535 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:43.062438 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-42a48e64-9c53-4574-b757-b3401d0d9535 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:43.070291 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-42a48e64-9c53-4574-b757-b3401d0d9535 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.163309 Jul 22 22:18:43.070855 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 393/814] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:42 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:44.086654 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6fe18b15-07e6-49e8-961c-1d1f1ec52135 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:44.087262 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6fe18b15-07e6-49e8-961c-1d1f1ec52135 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:44.093774 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6fe18b15-07e6-49e8-961c-1d1f1ec52135 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:44.094259 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6fe18b15-07e6-49e8-961c-1d1f1ec52135 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:44.095087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6fe18b15-07e6-49e8-961c-1d1f1ec52135 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:44.095504 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6fe18b15-07e6-49e8-961c-1d1f1ec52135 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:44.435186 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6fe18b15-07e6-49e8-961c-1d1f1ec52135 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:44.444449 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6fe18b15-07e6-49e8-961c-1d1f1ec52135 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.361348 Jul 22 22:18:44.445019 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 422/815] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:44 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:45.464407 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0bbb70d3-220e-42ae-a8e4-1b176f383360 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:45.464966 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0bbb70d3-220e-42ae-a8e4-1b176f383360 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:45.475215 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0bbb70d3-220e-42ae-a8e4-1b176f383360 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:45.476089 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0bbb70d3-220e-42ae-a8e4-1b176f383360 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:45.477603 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0bbb70d3-220e-42ae-a8e4-1b176f383360 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:45.478458 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0bbb70d3-220e-42ae-a8e4-1b176f383360 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:45.633822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0bbb70d3-220e-42ae-a8e4-1b176f383360 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:45.643747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0bbb70d3-220e-42ae-a8e4-1b176f383360 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.183069 Jul 22 22:18:45.644401 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 394/816] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:45 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:46.660425 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5ca05d38-73d6-4cde-ba71-04d26bd7d86e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:46.661064 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5ca05d38-73d6-4cde-ba71-04d26bd7d86e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:46.666894 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ca05d38-73d6-4cde-ba71-04d26bd7d86e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:46.667338 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ca05d38-73d6-4cde-ba71-04d26bd7d86e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:46.668101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ca05d38-73d6-4cde-ba71-04d26bd7d86e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:46.668569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ca05d38-73d6-4cde-ba71-04d26bd7d86e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:46.804489 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5ca05d38-73d6-4cde-ba71-04d26bd7d86e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:46.813169 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5ca05d38-73d6-4cde-ba71-04d26bd7d86e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.156354 Jul 22 22:18:46.813736 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 423/817] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:46 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:47.830822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e1586bf3-197a-4692-bfd0-316adb382d20 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:47.831428 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e1586bf3-197a-4692-bfd0-316adb382d20 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:47.837491 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e1586bf3-197a-4692-bfd0-316adb382d20 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:47.837796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e1586bf3-197a-4692-bfd0-316adb382d20 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:47.838575 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e1586bf3-197a-4692-bfd0-316adb382d20 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:47.839013 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e1586bf3-197a-4692-bfd0-316adb382d20 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:47.979070 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e1586bf3-197a-4692-bfd0-316adb382d20 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:47.987338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e1586bf3-197a-4692-bfd0-316adb382d20 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.161751 Jul 22 22:18:47.987923 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 395/818] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:47 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:49.004262 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-34d8245f-5622-4bfa-93a0-dddf896b2512 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:49.004978 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-34d8245f-5622-4bfa-93a0-dddf896b2512 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:49.010705 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34d8245f-5622-4bfa-93a0-dddf896b2512 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:49.011195 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34d8245f-5622-4bfa-93a0-dddf896b2512 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:49.012229 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34d8245f-5622-4bfa-93a0-dddf896b2512 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:49.012975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34d8245f-5622-4bfa-93a0-dddf896b2512 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:49.160165 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-34d8245f-5622-4bfa-93a0-dddf896b2512 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:49.168263 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-34d8245f-5622-4bfa-93a0-dddf896b2512 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.167535 Jul 22 22:18:49.168860 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 424/819] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:48 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:50.187226 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-acb67312-2972-4656-9541-ed95b11d5364 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:50.188055 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-acb67312-2972-4656-9541-ed95b11d5364 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:50.194278 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-acb67312-2972-4656-9541-ed95b11d5364 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:50.194728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-acb67312-2972-4656-9541-ed95b11d5364 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:50.195510 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-acb67312-2972-4656-9541-ed95b11d5364 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:50.195948 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-acb67312-2972-4656-9541-ed95b11d5364 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:50.333236 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-acb67312-2972-4656-9541-ed95b11d5364 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:50.340954 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-acb67312-2972-4656-9541-ed95b11d5364 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.158118 Jul 22 22:18:50.341519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 396/820] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:50 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:51.358125 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c222682c-875f-495c-b71d-95945074e24f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:51.358879 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c222682c-875f-495c-b71d-95945074e24f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:51.364767 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c222682c-875f-495c-b71d-95945074e24f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:51.365209 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c222682c-875f-495c-b71d-95945074e24f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:51.365970 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c222682c-875f-495c-b71d-95945074e24f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:51.366404 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c222682c-875f-495c-b71d-95945074e24f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:51.503650 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c222682c-875f-495c-b71d-95945074e24f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:51.511520 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c222682c-875f-495c-b71d-95945074e24f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.157251 Jul 22 22:18:51.512077 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 425/821] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:51 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:52.529507 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c0e47c32-1772-47a2-aec1-57a16f9ba826 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:52.530823 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c0e47c32-1772-47a2-aec1-57a16f9ba826 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:52.536691 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c0e47c32-1772-47a2-aec1-57a16f9ba826 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:52.537132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c0e47c32-1772-47a2-aec1-57a16f9ba826 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:52.537884 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c0e47c32-1772-47a2-aec1-57a16f9ba826 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:52.538310 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c0e47c32-1772-47a2-aec1-57a16f9ba826 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:52.677765 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c0e47c32-1772-47a2-aec1-57a16f9ba826 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:52.685777 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c0e47c32-1772-47a2-aec1-57a16f9ba826 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.159943 Jul 22 22:18:52.686405 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 397/822] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:52 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:53.702575 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-29bcbd12-9435-434b-a957-ea34f5a4082a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:53.703181 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-29bcbd12-9435-434b-a957-ea34f5a4082a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:53.708981 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-29bcbd12-9435-434b-a957-ea34f5a4082a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:53.709419 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-29bcbd12-9435-434b-a957-ea34f5a4082a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:53.710168 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-29bcbd12-9435-434b-a957-ea34f5a4082a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:53.710592 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-29bcbd12-9435-434b-a957-ea34f5a4082a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:53.849920 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-29bcbd12-9435-434b-a957-ea34f5a4082a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:53.857688 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-29bcbd12-9435-434b-a957-ea34f5a4082a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.158804 Jul 22 22:18:53.858871 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 426/823] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:53 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:54.875488 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-565c3557-31f5-4d9d-8bde-9c01f9341d40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:54.877090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-565c3557-31f5-4d9d-8bde-9c01f9341d40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:54.883139 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-565c3557-31f5-4d9d-8bde-9c01f9341d40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:54.883592 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-565c3557-31f5-4d9d-8bde-9c01f9341d40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:54.884398 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-565c3557-31f5-4d9d-8bde-9c01f9341d40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:54.884839 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-565c3557-31f5-4d9d-8bde-9c01f9341d40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:55.030895 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-565c3557-31f5-4d9d-8bde-9c01f9341d40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:55.039428 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-565c3557-31f5-4d9d-8bde-9c01f9341d40 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.167716 Jul 22 22:18:55.039987 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 398/824] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:54 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:56.057227 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1d9d7cef-3d23-4608-8022-1ec1cd0a410e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:56.057834 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1d9d7cef-3d23-4608-8022-1ec1cd0a410e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:56.064158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d9d7cef-3d23-4608-8022-1ec1cd0a410e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:56.064623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d9d7cef-3d23-4608-8022-1ec1cd0a410e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:56.065384 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d9d7cef-3d23-4608-8022-1ec1cd0a410e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:56.065813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d9d7cef-3d23-4608-8022-1ec1cd0a410e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:56.214618 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1d9d7cef-3d23-4608-8022-1ec1cd0a410e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:56.223159 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1d9d7cef-3d23-4608-8022-1ec1cd0a410e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.169640 Jul 22 22:18:56.224772 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 427/825] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:56 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:57.241987 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6c61a22f-1bc9-4c26-b294-ac9506433f1a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:57.242583 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6c61a22f-1bc9-4c26-b294-ac9506433f1a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:57.249016 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6c61a22f-1bc9-4c26-b294-ac9506433f1a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:57.249472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6c61a22f-1bc9-4c26-b294-ac9506433f1a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:57.250404 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6c61a22f-1bc9-4c26-b294-ac9506433f1a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:57.252469 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6c61a22f-1bc9-4c26-b294-ac9506433f1a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:57.393418 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6c61a22f-1bc9-4c26-b294-ac9506433f1a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:57.401074 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6c61a22f-1bc9-4c26-b294-ac9506433f1a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.162908 Jul 22 22:18:57.401640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 399/826] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:57 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:18:58.418569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-699b213f-74a6-4c7a-bedd-184082d24ce8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:58.419174 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-699b213f-74a6-4c7a-bedd-184082d24ce8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:58.425597 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-699b213f-74a6-4c7a-bedd-184082d24ce8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:58.425977 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-699b213f-74a6-4c7a-bedd-184082d24ce8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:58.426743 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-699b213f-74a6-4c7a-bedd-184082d24ce8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:58.427375 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-699b213f-74a6-4c7a-bedd-184082d24ce8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:58.571626 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-699b213f-74a6-4c7a-bedd-184082d24ce8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:58.580603 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-699b213f-74a6-4c7a-bedd-184082d24ce8 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.165668 Jul 22 22:18:58.581179 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 428/827] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:58 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:18:59.597709 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-454bac8f-71e7-4ac7-8e58-dc9da0ad099c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:18:59.598338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-454bac8f-71e7-4ac7-8e58-dc9da0ad099c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:18:59.604048 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-454bac8f-71e7-4ac7-8e58-dc9da0ad099c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:59.604533 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-454bac8f-71e7-4ac7-8e58-dc9da0ad099c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:59.605292 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-454bac8f-71e7-4ac7-8e58-dc9da0ad099c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:18:59.605719 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-454bac8f-71e7-4ac7-8e58-dc9da0ad099c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:18:59.750153 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-454bac8f-71e7-4ac7-8e58-dc9da0ad099c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:18:59.759635 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-454bac8f-71e7-4ac7-8e58-dc9da0ad099c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.165648 Jul 22 22:18:59.760322 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 400/828] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:18:59 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:00.777974 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-eadd0267-341b-46a4-b7ce-714105d86ddb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:00.778610 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-eadd0267-341b-46a4-b7ce-714105d86ddb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:00.785828 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eadd0267-341b-46a4-b7ce-714105d86ddb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:00.786606 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eadd0267-341b-46a4-b7ce-714105d86ddb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:00.787946 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eadd0267-341b-46a4-b7ce-714105d86ddb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:00.787946 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eadd0267-341b-46a4-b7ce-714105d86ddb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:00.932038 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-eadd0267-341b-46a4-b7ce-714105d86ddb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:00.940618 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-eadd0267-341b-46a4-b7ce-714105d86ddb tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.166910 Jul 22 22:19:00.941197 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 429/829] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:00 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:01.958169 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-06b4f105-f2b7-46ed-ba6d-4c7e6a027eff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:01.958922 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-06b4f105-f2b7-46ed-ba6d-4c7e6a027eff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:01.964888 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-06b4f105-f2b7-46ed-ba6d-4c7e6a027eff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:01.965338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-06b4f105-f2b7-46ed-ba6d-4c7e6a027eff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:01.966118 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-06b4f105-f2b7-46ed-ba6d-4c7e6a027eff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:01.967016 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-06b4f105-f2b7-46ed-ba6d-4c7e6a027eff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:02.115273 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-06b4f105-f2b7-46ed-ba6d-4c7e6a027eff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:02.123434 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-06b4f105-f2b7-46ed-ba6d-4c7e6a027eff tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.169730 Jul 22 22:19:02.133769 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 401/830] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:01 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:02.292674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7dbdbfac-5d87-495f-85dd-3b9e52cb44b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:02.293471 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7dbdbfac-5d87-495f-85dd-3b9e52cb44b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:02.299627 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7dbdbfac-5d87-495f-85dd-3b9e52cb44b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:02.300067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7dbdbfac-5d87-495f-85dd-3b9e52cb44b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:02.300923 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7dbdbfac-5d87-495f-85dd-3b9e52cb44b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:02.301446 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7dbdbfac-5d87-495f-85dd-3b9e52cb44b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:02.390138 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-7dbdbfac-5d87-495f-85dd-3b9e52cb44b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lazy-loading 'services' on Instance uuid 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:19:02.457152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7dbdbfac-5d87-495f-85dd-3b9e52cb44b5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "DELETE /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/os-volume_attachments/dfce17e8-b236-42f0-8b61-6264a28db7df" status: 202 len: 0 microversion: 2.1 time: 0.414062 Jul 22 22:19:02.457914 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 430/831] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:19:02 2021] DELETE /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/os-volume_attachments/dfce17e8-b236-42f0-8b61-6264a28db7df => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:19:03.141378 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-074640a8-525b-4dcb-ac0c-d71fa97f46ab tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:03.142013 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-074640a8-525b-4dcb-ac0c-d71fa97f46ab tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:03.147943 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-074640a8-525b-4dcb-ac0c-d71fa97f46ab tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:03.148487 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-074640a8-525b-4dcb-ac0c-d71fa97f46ab tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:03.149260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-074640a8-525b-4dcb-ac0c-d71fa97f46ab tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:03.149686 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-074640a8-525b-4dcb-ac0c-d71fa97f46ab tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:03.292603 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-074640a8-525b-4dcb-ac0c-d71fa97f46ab tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:03.301061 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-074640a8-525b-4dcb-ac0c-d71fa97f46ab tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.163556 Jul 22 22:19:03.301681 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 402/832] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:03 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:04.318172 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bbd65b17-5b26-407b-8878-1a3794bd5d61 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:04.318874 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-bbd65b17-5b26-407b-8878-1a3794bd5d61 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:04.324982 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bbd65b17-5b26-407b-8878-1a3794bd5d61 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:04.325429 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bbd65b17-5b26-407b-8878-1a3794bd5d61 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:04.326218 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bbd65b17-5b26-407b-8878-1a3794bd5d61 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:04.326661 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bbd65b17-5b26-407b-8878-1a3794bd5d61 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:04.469347 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-bbd65b17-5b26-407b-8878-1a3794bd5d61 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:04.477257 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-bbd65b17-5b26-407b-8878-1a3794bd5d61 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.163100 Jul 22 22:19:04.477825 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 431/833] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:04 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:04.647720 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f0826b59-588b-4b43-b597-d4e4b8279ad4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:19:04.653727 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f0826b59-588b-4b43-b597-d4e4b8279ad4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:04.654195 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f0826b59-588b-4b43-b597-d4e4b8279ad4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:04.678532 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f0826b59-588b-4b43-b597-d4e4b8279ad4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Going to try to stop instance {{(pid=107498) force_stop /opt/stack/nova/nova/compute/api.py:2582}} Jul 22 22:19:04.721751 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f0826b59-588b-4b43-b597-d4e4b8279ad4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 202 len: 0 microversion: 2.1 time: 0.077706 Jul 22 22:19:04.722423 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 403/834] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:19:04 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:19:04.730380 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fa746a15-02fb-4478-9145-2739213667a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:04.730990 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fa746a15-02fb-4478-9145-2739213667a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:04.737284 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fa746a15-02fb-4478-9145-2739213667a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:04.737722 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fa746a15-02fb-4478-9145-2739213667a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:04.738491 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fa746a15-02fb-4478-9145-2739213667a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:04.738917 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fa746a15-02fb-4478-9145-2739213667a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:04.880881 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fa746a15-02fb-4478-9145-2739213667a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:04.888120 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fa746a15-02fb-4478-9145-2739213667a9 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.161444 Jul 22 22:19:04.889062 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 432/835] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:04 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:05.495713 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ab802557-8b54-4788-b98c-2a0d9916486b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:05.496588 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ab802557-8b54-4788-b98c-2a0d9916486b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:05.503932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab802557-8b54-4788-b98c-2a0d9916486b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:05.504486 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab802557-8b54-4788-b98c-2a0d9916486b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:05.505326 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab802557-8b54-4788-b98c-2a0d9916486b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:05.505830 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab802557-8b54-4788-b98c-2a0d9916486b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:05.703054 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ab802557-8b54-4788-b98c-2a0d9916486b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:05.711746 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ab802557-8b54-4788-b98c-2a0d9916486b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.220201 Jul 22 22:19:05.712637 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 404/836] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:05 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:05.905597 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7e6ef264-2423-4999-9bc4-75d0b6f0bf2d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:05.906196 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7e6ef264-2423-4999-9bc4-75d0b6f0bf2d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:05.913421 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e6ef264-2423-4999-9bc4-75d0b6f0bf2d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:05.914166 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e6ef264-2423-4999-9bc4-75d0b6f0bf2d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:05.915575 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e6ef264-2423-4999-9bc4-75d0b6f0bf2d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:05.916431 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e6ef264-2423-4999-9bc4-75d0b6f0bf2d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:06.061305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7e6ef264-2423-4999-9bc4-75d0b6f0bf2d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:06.069370 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7e6ef264-2423-4999-9bc4-75d0b6f0bf2d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.167229 Jul 22 22:19:06.070017 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 433/837] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:05 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:06.729909 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ffb5b7e9-eb7e-4fdb-bb59-79d07db2065a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:06.730546 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ffb5b7e9-eb7e-4fdb-bb59-79d07db2065a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:06.737550 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ffb5b7e9-eb7e-4fdb-bb59-79d07db2065a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:06.737998 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ffb5b7e9-eb7e-4fdb-bb59-79d07db2065a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:06.738776 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ffb5b7e9-eb7e-4fdb-bb59-79d07db2065a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:06.739211 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ffb5b7e9-eb7e-4fdb-bb59-79d07db2065a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:06.888231 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ffb5b7e9-eb7e-4fdb-bb59-79d07db2065a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:06.896780 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ffb5b7e9-eb7e-4fdb-bb59-79d07db2065a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.170575 Jul 22 22:19:06.897352 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 405/838] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:06 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:07.090308 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a035c5ce-bec8-48e5-b8c7-fe6164755c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:07.091617 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a035c5ce-bec8-48e5-b8c7-fe6164755c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:07.101547 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a035c5ce-bec8-48e5-b8c7-fe6164755c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:07.102331 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a035c5ce-bec8-48e5-b8c7-fe6164755c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:07.103607 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a035c5ce-bec8-48e5-b8c7-fe6164755c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:07.104354 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a035c5ce-bec8-48e5-b8c7-fe6164755c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:07.261245 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a035c5ce-bec8-48e5-b8c7-fe6164755c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:07.269398 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a035c5ce-bec8-48e5-b8c7-fe6164755c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.184937 Jul 22 22:19:07.270078 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 434/839] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:07 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:07.913579 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-065699fc-b902-406f-ae63-d3e803faff00 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:07.914186 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-065699fc-b902-406f-ae63-d3e803faff00 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:07.920295 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-065699fc-b902-406f-ae63-d3e803faff00 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:07.920763 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-065699fc-b902-406f-ae63-d3e803faff00 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:07.921547 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-065699fc-b902-406f-ae63-d3e803faff00 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:07.922278 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-065699fc-b902-406f-ae63-d3e803faff00 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:08.061427 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-065699fc-b902-406f-ae63-d3e803faff00 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:08.070297 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-065699fc-b902-406f-ae63-d3e803faff00 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.160308 Jul 22 22:19:08.070870 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 406/840] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:07 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:08.287557 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-67c32e45-2e0c-43ff-bbe7-01aae88efdd5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:08.288456 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-67c32e45-2e0c-43ff-bbe7-01aae88efdd5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:08.295698 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67c32e45-2e0c-43ff-bbe7-01aae88efdd5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:08.296141 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67c32e45-2e0c-43ff-bbe7-01aae88efdd5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:08.297328 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67c32e45-2e0c-43ff-bbe7-01aae88efdd5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:08.297499 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-67c32e45-2e0c-43ff-bbe7-01aae88efdd5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:08.435058 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-67c32e45-2e0c-43ff-bbe7-01aae88efdd5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:08.443877 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-67c32e45-2e0c-43ff-bbe7-01aae88efdd5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.160576 Jul 22 22:19:08.444466 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 435/841] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:08 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:19:09.089042 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ccb9c722-be89-4ae1-8e21-3ce97ed096cd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:09.089660 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ccb9c722-be89-4ae1-8e21-3ce97ed096cd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:09.096544 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ccb9c722-be89-4ae1-8e21-3ce97ed096cd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:09.096992 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ccb9c722-be89-4ae1-8e21-3ce97ed096cd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:09.097764 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ccb9c722-be89-4ae1-8e21-3ce97ed096cd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:09.098200 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ccb9c722-be89-4ae1-8e21-3ce97ed096cd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:09.233233 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ccb9c722-be89-4ae1-8e21-3ce97ed096cd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:09.241929 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ccb9c722-be89-4ae1-8e21-3ce97ed096cd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.156990 Jul 22 22:19:09.242500 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 407/842] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:09 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:09.460738 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-87adac18-548f-46d8-a0b0-4765ae23fb6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:09.461285 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-87adac18-548f-46d8-a0b0-4765ae23fb6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:09.467649 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-87adac18-548f-46d8-a0b0-4765ae23fb6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:09.468096 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-87adac18-548f-46d8-a0b0-4765ae23fb6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:09.469552 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-87adac18-548f-46d8-a0b0-4765ae23fb6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:09.469996 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-87adac18-548f-46d8-a0b0-4765ae23fb6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:09.607803 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-87adac18-548f-46d8-a0b0-4765ae23fb6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:09.615752 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-87adac18-548f-46d8-a0b0-4765ae23fb6c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.158745 Jul 22 22:19:09.616342 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 436/843] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:09 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:10.259357 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-63b75bc4-9e61-484d-a2a0-6c4d7ff2df87 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:10.259979 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-63b75bc4-9e61-484d-a2a0-6c4d7ff2df87 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:10.267994 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-63b75bc4-9e61-484d-a2a0-6c4d7ff2df87 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:10.267994 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-63b75bc4-9e61-484d-a2a0-6c4d7ff2df87 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:10.268627 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-63b75bc4-9e61-484d-a2a0-6c4d7ff2df87 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:10.269065 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-63b75bc4-9e61-484d-a2a0-6c4d7ff2df87 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:10.410756 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-63b75bc4-9e61-484d-a2a0-6c4d7ff2df87 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:10.418935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-63b75bc4-9e61-484d-a2a0-6c4d7ff2df87 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.163279 Jul 22 22:19:10.419537 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 408/844] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:10 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:10.633567 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-22b3202b-69eb-4741-be81-5e5601abd5d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:10.634112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-22b3202b-69eb-4741-be81-5e5601abd5d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:10.639881 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22b3202b-69eb-4741-be81-5e5601abd5d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:10.640353 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22b3202b-69eb-4741-be81-5e5601abd5d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:10.641115 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22b3202b-69eb-4741-be81-5e5601abd5d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:10.641555 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22b3202b-69eb-4741-be81-5e5601abd5d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:10.777482 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-22b3202b-69eb-4741-be81-5e5601abd5d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:10.785243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-22b3202b-69eb-4741-be81-5e5601abd5d1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.155403 Jul 22 22:19:10.785811 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 437/845] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:10 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:11.436235 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-80b77118-e09d-4ba5-ac61-bbc743b79bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:11.436885 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-80b77118-e09d-4ba5-ac61-bbc743b79bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:11.444003 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-80b77118-e09d-4ba5-ac61-bbc743b79bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:11.444493 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-80b77118-e09d-4ba5-ac61-bbc743b79bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:11.445272 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-80b77118-e09d-4ba5-ac61-bbc743b79bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:11.445709 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-80b77118-e09d-4ba5-ac61-bbc743b79bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:11.580645 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-80b77118-e09d-4ba5-ac61-bbc743b79bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:11.588350 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-80b77118-e09d-4ba5-ac61-bbc743b79bfd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.155815 Jul 22 22:19:11.588914 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 409/846] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:11 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:11.802795 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8f8e0e95-8de4-4a9c-8241-c528c84de9f6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:11.803352 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8f8e0e95-8de4-4a9c-8241-c528c84de9f6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:11.809225 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f8e0e95-8de4-4a9c-8241-c528c84de9f6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:11.809705 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f8e0e95-8de4-4a9c-8241-c528c84de9f6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:11.810536 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f8e0e95-8de4-4a9c-8241-c528c84de9f6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:11.810973 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f8e0e95-8de4-4a9c-8241-c528c84de9f6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:11.956383 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8f8e0e95-8de4-4a9c-8241-c528c84de9f6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:11.963707 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8f8e0e95-8de4-4a9c-8241-c528c84de9f6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.165340 Jul 22 22:19:11.964335 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 438/847] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:11 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:12.606321 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7b4ca5ff-2335-4ef4-9889-cc5c47b90fc9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:12.606935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7b4ca5ff-2335-4ef4-9889-cc5c47b90fc9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:12.613464 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b4ca5ff-2335-4ef4-9889-cc5c47b90fc9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:12.613907 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b4ca5ff-2335-4ef4-9889-cc5c47b90fc9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:12.614677 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b4ca5ff-2335-4ef4-9889-cc5c47b90fc9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:12.615106 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b4ca5ff-2335-4ef4-9889-cc5c47b90fc9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:12.761222 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7b4ca5ff-2335-4ef4-9889-cc5c47b90fc9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:12.768954 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7b4ca5ff-2335-4ef4-9889-cc5c47b90fc9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.166380 Jul 22 22:19:12.769511 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 410/848] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:12 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:12.982587 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d5fc00c5-141f-474f-bb82-638e75a2ba5a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:12.989806 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d5fc00c5-141f-474f-bb82-638e75a2ba5a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:12.990714 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d5fc00c5-141f-474f-bb82-638e75a2ba5a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:12.991362 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d5fc00c5-141f-474f-bb82-638e75a2ba5a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:12.992343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d5fc00c5-141f-474f-bb82-638e75a2ba5a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:12.992936 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d5fc00c5-141f-474f-bb82-638e75a2ba5a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:13.159133 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d5fc00c5-141f-474f-bb82-638e75a2ba5a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:13.166540 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d5fc00c5-141f-474f-bb82-638e75a2ba5a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.187752 Jul 22 22:19:13.172332 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 439/849] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:12 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:13.785216 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4282908b-83e9-49cc-8741-8a4fe4b7676f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:13.785852 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4282908b-83e9-49cc-8741-8a4fe4b7676f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:13.791844 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4282908b-83e9-49cc-8741-8a4fe4b7676f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:13.792314 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4282908b-83e9-49cc-8741-8a4fe4b7676f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:13.793114 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4282908b-83e9-49cc-8741-8a4fe4b7676f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:13.793530 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4282908b-83e9-49cc-8741-8a4fe4b7676f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:13.929053 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4282908b-83e9-49cc-8741-8a4fe4b7676f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:13.936818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4282908b-83e9-49cc-8741-8a4fe4b7676f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.155512 Jul 22 22:19:13.937375 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 411/850] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:13 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:14.184197 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fe339256-ce54-469c-a705-dca35c197258 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:14.185003 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fe339256-ce54-469c-a705-dca35c197258 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:14.191229 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fe339256-ce54-469c-a705-dca35c197258 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:14.192878 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fe339256-ce54-469c-a705-dca35c197258 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:14.192878 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fe339256-ce54-469c-a705-dca35c197258 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:14.192878 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fe339256-ce54-469c-a705-dca35c197258 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:14.331706 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fe339256-ce54-469c-a705-dca35c197258 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:14.339598 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fe339256-ce54-469c-a705-dca35c197258 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.159028 Jul 22 22:19:14.340165 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 440/851] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:14 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:14.953740 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-07266940-ea86-43a5-a7ac-babc932ebba7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:14.955925 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-07266940-ea86-43a5-a7ac-babc932ebba7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:14.961871 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-07266940-ea86-43a5-a7ac-babc932ebba7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:14.962319 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-07266940-ea86-43a5-a7ac-babc932ebba7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:14.963102 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-07266940-ea86-43a5-a7ac-babc932ebba7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:14.963540 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-07266940-ea86-43a5-a7ac-babc932ebba7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:15.110968 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-07266940-ea86-43a5-a7ac-babc932ebba7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:15.118855 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-07266940-ea86-43a5-a7ac-babc932ebba7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.168771 Jul 22 22:19:15.119416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 412/852] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:14 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:15.357568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1247514e-3915-4fae-8ebc-e588f1decd1e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:15.358177 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1247514e-3915-4fae-8ebc-e588f1decd1e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:15.364177 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1247514e-3915-4fae-8ebc-e588f1decd1e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:15.364660 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1247514e-3915-4fae-8ebc-e588f1decd1e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:15.365421 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1247514e-3915-4fae-8ebc-e588f1decd1e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:15.365854 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1247514e-3915-4fae-8ebc-e588f1decd1e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:15.504709 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1247514e-3915-4fae-8ebc-e588f1decd1e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:15.511969 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1247514e-3915-4fae-8ebc-e588f1decd1e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.158177 Jul 22 22:19:15.512556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 441/853] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:15 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:16.135943 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0db1bb25-dafb-4059-baac-0e81088b665f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:16.136590 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0db1bb25-dafb-4059-baac-0e81088b665f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:16.143206 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0db1bb25-dafb-4059-baac-0e81088b665f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:16.143661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0db1bb25-dafb-4059-baac-0e81088b665f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:16.144483 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0db1bb25-dafb-4059-baac-0e81088b665f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:16.144922 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0db1bb25-dafb-4059-baac-0e81088b665f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:16.284383 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0db1bb25-dafb-4059-baac-0e81088b665f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:16.292634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0db1bb25-dafb-4059-baac-0e81088b665f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.160307 Jul 22 22:19:16.293199 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 413/854] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:16 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:16.529363 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8953df0f-5e22-4087-bf5d-4f05689fe404 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:16.529964 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8953df0f-5e22-4087-bf5d-4f05689fe404 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:16.536720 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8953df0f-5e22-4087-bf5d-4f05689fe404 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:16.537107 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8953df0f-5e22-4087-bf5d-4f05689fe404 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:16.537874 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8953df0f-5e22-4087-bf5d-4f05689fe404 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:16.538308 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8953df0f-5e22-4087-bf5d-4f05689fe404 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:16.678430 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8953df0f-5e22-4087-bf5d-4f05689fe404 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:16.685872 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8953df0f-5e22-4087-bf5d-4f05689fe404 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.160224 Jul 22 22:19:16.686434 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 442/855] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:16 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:17.310698 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fed7af6c-124e-4083-a329-cda5561be40e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:17.311306 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fed7af6c-124e-4083-a329-cda5561be40e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:17.317261 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fed7af6c-124e-4083-a329-cda5561be40e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:17.317707 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fed7af6c-124e-4083-a329-cda5561be40e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:17.318477 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fed7af6c-124e-4083-a329-cda5561be40e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:17.318913 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fed7af6c-124e-4083-a329-cda5561be40e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:17.456416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fed7af6c-124e-4083-a329-cda5561be40e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:17.464327 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fed7af6c-124e-4083-a329-cda5561be40e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.157163 Jul 22 22:19:17.464817 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 414/856] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:17 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:17.703663 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-faf221cd-fd49-42f6-832f-230d12dffdf6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:17.704303 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-faf221cd-fd49-42f6-832f-230d12dffdf6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:17.710353 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-faf221cd-fd49-42f6-832f-230d12dffdf6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:17.710794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-faf221cd-fd49-42f6-832f-230d12dffdf6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:17.711566 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-faf221cd-fd49-42f6-832f-230d12dffdf6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:17.711999 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-faf221cd-fd49-42f6-832f-230d12dffdf6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:17.850623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-faf221cd-fd49-42f6-832f-230d12dffdf6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:17.858284 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-faf221cd-fd49-42f6-832f-230d12dffdf6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.158482 Jul 22 22:19:17.858852 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 443/857] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:17 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:18.480982 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e62ebd93-72fe-4e6b-af09-173d8affb57f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:18.481612 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e62ebd93-72fe-4e6b-af09-173d8affb57f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:18.488190 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e62ebd93-72fe-4e6b-af09-173d8affb57f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:18.488657 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e62ebd93-72fe-4e6b-af09-173d8affb57f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:18.489422 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e62ebd93-72fe-4e6b-af09-173d8affb57f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:18.489885 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e62ebd93-72fe-4e6b-af09-173d8affb57f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:18.641653 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e62ebd93-72fe-4e6b-af09-173d8affb57f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:18.650445 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e62ebd93-72fe-4e6b-af09-173d8affb57f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1572 microversion: 2.1 time: 0.173176 Jul 22 22:19:18.651011 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 415/858] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:18 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1572 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:18.875568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-70fabfb4-662a-43c5-8b29-06001928b34d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:18.876194 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-70fabfb4-662a-43c5-8b29-06001928b34d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:18.882496 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70fabfb4-662a-43c5-8b29-06001928b34d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:18.882936 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70fabfb4-662a-43c5-8b29-06001928b34d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:18.883758 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70fabfb4-662a-43c5-8b29-06001928b34d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:18.884862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-70fabfb4-662a-43c5-8b29-06001928b34d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:19.027778 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-70fabfb4-662a-43c5-8b29-06001928b34d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:19.035273 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-70fabfb4-662a-43c5-8b29-06001928b34d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.163465 Jul 22 22:19:19.035826 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 444/859] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:18 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:19.667356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b056a0ac-af3f-4ef3-b694-267823fe71ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:19.668025 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b056a0ac-af3f-4ef3-b694-267823fe71ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:19.674106 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b056a0ac-af3f-4ef3-b694-267823fe71ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:19.675077 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b056a0ac-af3f-4ef3-b694-267823fe71ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:19.676146 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b056a0ac-af3f-4ef3-b694-267823fe71ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:19.676620 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b056a0ac-af3f-4ef3-b694-267823fe71ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:19.817580 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b056a0ac-af3f-4ef3-b694-267823fe71ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:19.825464 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b056a0ac-af3f-4ef3-b694-267823fe71ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1552 microversion: 2.1 time: 0.162315 Jul 22 22:19:19.826017 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 416/860] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:19 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:19.842155 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fff316a9-7ea9-451b-b4be-7feb29cdda67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:19.842719 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fff316a9-7ea9-451b-b4be-7feb29cdda67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:19.849745 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fff316a9-7ea9-451b-b4be-7feb29cdda67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:19.850146 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fff316a9-7ea9-451b-b4be-7feb29cdda67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:19.850907 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fff316a9-7ea9-451b-b4be-7feb29cdda67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:19.851336 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fff316a9-7ea9-451b-b4be-7feb29cdda67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:19.936835 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-fff316a9-7ea9-451b-b4be-7feb29cdda67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] HTTP exception thrown: Cannot 'detach_volume' instance c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae while it is in vm_state rescued Jul 22 22:19:19.937437 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fff316a9-7ea9-451b-b4be-7feb29cdda67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Returning 409 to user: Cannot 'detach_volume' instance c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae while it is in vm_state rescued {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:19:19.938244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fff316a9-7ea9-451b-b4be-7feb29cdda67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "DELETE /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/os-volume_attachments/eaf9284e-fb77-4265-8628-8b5de92d43a1" status: 409 len: 152 microversion: 2.1 time: 0.100141 Jul 22 22:19:19.938786 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 445/861] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:19:19 2021] DELETE /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/os-volume_attachments/eaf9284e-fb77-4265-8628-8b5de92d43a1 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 22 22:19:19.947456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cc553c61-1302-4143-a42d-dd8170615dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:19:19.949355 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cc553c61-1302-4143-a42d-dd8170615dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:19.953899 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc553c61-1302-4143-a42d-dd8170615dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:19.954353 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc553c61-1302-4143-a42d-dd8170615dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:19.955123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc553c61-1302-4143-a42d-dd8170615dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:19.955555 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc553c61-1302-4143-a42d-dd8170615dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:20.021516 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cc553c61-1302-4143-a42d-dd8170615dd5 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/action" status: 202 len: 0 microversion: 2.1 time: 0.077570 Jul 22 22:19:20.022361 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 417/862] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:19:19 2021] POST /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:19:20.030006 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-861306dc-8e38-45ad-9140-5631034ef18b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:20.030998 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-861306dc-8e38-45ad-9140-5631034ef18b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:20.039201 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-861306dc-8e38-45ad-9140-5631034ef18b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:20.039643 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-861306dc-8e38-45ad-9140-5631034ef18b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:20.040463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-861306dc-8e38-45ad-9140-5631034ef18b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:20.040869 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-861306dc-8e38-45ad-9140-5631034ef18b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:20.053640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e6347533-d153-4933-91e3-2721aa31fefe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:20.054350 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e6347533-d153-4933-91e3-2721aa31fefe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:20.060733 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e6347533-d153-4933-91e3-2721aa31fefe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:20.061184 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e6347533-d153-4933-91e3-2721aa31fefe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:20.061963 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e6347533-d153-4933-91e3-2721aa31fefe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:20.062424 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e6347533-d153-4933-91e3-2721aa31fefe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:20.204782 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e6347533-d153-4933-91e3-2721aa31fefe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:20.214319 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e6347533-d153-4933-91e3-2721aa31fefe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.164995 Jul 22 22:19:20.214609 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 418/863] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:20 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:19:20.228666 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-861306dc-8e38-45ad-9140-5631034ef18b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:20.236246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-861306dc-8e38-45ad-9140-5631034ef18b tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1560 microversion: 2.1 time: 0.209891 Jul 22 22:19:20.236889 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 446/864] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:20 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:21.231485 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5f82d584-2039-4b8a-ad68-9424f8b62286 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:21.232091 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5f82d584-2039-4b8a-ad68-9424f8b62286 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:21.238733 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5f82d584-2039-4b8a-ad68-9424f8b62286 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:21.239206 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5f82d584-2039-4b8a-ad68-9424f8b62286 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:21.240011 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5f82d584-2039-4b8a-ad68-9424f8b62286 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:21.240481 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5f82d584-2039-4b8a-ad68-9424f8b62286 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:21.253633 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-546e6724-839b-4b2e-aef0-dbf9750eca0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:21.254241 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-546e6724-839b-4b2e-aef0-dbf9750eca0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:21.260979 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-546e6724-839b-4b2e-aef0-dbf9750eca0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:21.261446 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-546e6724-839b-4b2e-aef0-dbf9750eca0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:21.262240 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-546e6724-839b-4b2e-aef0-dbf9750eca0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:21.262680 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-546e6724-839b-4b2e-aef0-dbf9750eca0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:21.385171 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5f82d584-2039-4b8a-ad68-9424f8b62286 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:21.392596 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5f82d584-2039-4b8a-ad68-9424f8b62286 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.164744 Jul 22 22:19:21.393156 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 419/865] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:21 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:21.403674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-546e6724-839b-4b2e-aef0-dbf9750eca0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:21.412026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-546e6724-839b-4b2e-aef0-dbf9750eca0d tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1560 microversion: 2.1 time: 0.162396 Jul 22 22:19:21.412633 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 447/866] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:21 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:19:22.408613 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7765de9c-9d17-4668-97dd-34860e6cadeb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:22.409334 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7765de9c-9d17-4668-97dd-34860e6cadeb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:22.415147 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7765de9c-9d17-4668-97dd-34860e6cadeb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:22.415585 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7765de9c-9d17-4668-97dd-34860e6cadeb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:22.416387 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7765de9c-9d17-4668-97dd-34860e6cadeb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:22.416818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7765de9c-9d17-4668-97dd-34860e6cadeb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:22.429739 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5ac1bcba-21e8-47ca-abf0-99fbc5396fc6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:22.430259 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5ac1bcba-21e8-47ca-abf0-99fbc5396fc6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:22.436543 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ac1bcba-21e8-47ca-abf0-99fbc5396fc6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:22.436993 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ac1bcba-21e8-47ca-abf0-99fbc5396fc6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:22.437772 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ac1bcba-21e8-47ca-abf0-99fbc5396fc6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:22.438245 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5ac1bcba-21e8-47ca-abf0-99fbc5396fc6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:22.553970 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7765de9c-9d17-4668-97dd-34860e6cadeb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:22.561739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7765de9c-9d17-4668-97dd-34860e6cadeb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.156713 Jul 22 22:19:22.562312 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 420/867] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:22 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:22.580041 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5ac1bcba-21e8-47ca-abf0-99fbc5396fc6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:22.588192 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5ac1bcba-21e8-47ca-abf0-99fbc5396fc6 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1560 microversion: 2.1 time: 0.162441 Jul 22 22:19:22.588800 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 448/868] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:22 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:19:23.579643 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2b1ddbbe-0249-4115-b052-7284021066ac tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:23.580259 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2b1ddbbe-0249-4115-b052-7284021066ac tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:23.587050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b1ddbbe-0249-4115-b052-7284021066ac tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:23.587499 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b1ddbbe-0249-4115-b052-7284021066ac tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:23.588290 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b1ddbbe-0249-4115-b052-7284021066ac tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:23.588737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2b1ddbbe-0249-4115-b052-7284021066ac tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:23.605238 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-256c44da-aa5b-4879-ba42-4ed1d9df006c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:23.605838 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-256c44da-aa5b-4879-ba42-4ed1d9df006c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:23.611501 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-256c44da-aa5b-4879-ba42-4ed1d9df006c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:23.612010 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-256c44da-aa5b-4879-ba42-4ed1d9df006c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:23.612823 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-256c44da-aa5b-4879-ba42-4ed1d9df006c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:23.613250 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-256c44da-aa5b-4879-ba42-4ed1d9df006c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:23.729490 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2b1ddbbe-0249-4115-b052-7284021066ac tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:23.738253 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2b1ddbbe-0249-4115-b052-7284021066ac tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.162211 Jul 22 22:19:23.738935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 421/869] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:23 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:23.758016 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-256c44da-aa5b-4879-ba42-4ed1d9df006c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:23.765839 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-256c44da-aa5b-4879-ba42-4ed1d9df006c tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1560 microversion: 2.1 time: 0.164246 Jul 22 22:19:23.766399 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 449/870] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:23 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:19:24.754919 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4cc6adf4-9c54-4577-8908-8c1a327a8af6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:24.755809 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4cc6adf4-9c54-4577-8908-8c1a327a8af6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:24.761818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4cc6adf4-9c54-4577-8908-8c1a327a8af6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:24.762262 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4cc6adf4-9c54-4577-8908-8c1a327a8af6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:24.763030 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4cc6adf4-9c54-4577-8908-8c1a327a8af6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:24.763458 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4cc6adf4-9c54-4577-8908-8c1a327a8af6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:24.782905 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-542f75e2-77f9-40b6-9191-7e4ab27e0ef9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:24.783502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-542f75e2-77f9-40b6-9191-7e4ab27e0ef9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:24.791030 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-542f75e2-77f9-40b6-9191-7e4ab27e0ef9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:24.791030 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-542f75e2-77f9-40b6-9191-7e4ab27e0ef9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:24.791811 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-542f75e2-77f9-40b6-9191-7e4ab27e0ef9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:24.792242 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-542f75e2-77f9-40b6-9191-7e4ab27e0ef9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:24.927629 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4cc6adf4-9c54-4577-8908-8c1a327a8af6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:24.935167 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4cc6adf4-9c54-4577-8908-8c1a327a8af6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1684 microversion: 2.1 time: 0.183994 Jul 22 22:19:24.935741 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 422/871] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:24 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1684 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:19:24.937224 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-542f75e2-77f9-40b6-9191-7e4ab27e0ef9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:24.946208 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-542f75e2-77f9-40b6-9191-7e4ab27e0ef9 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1560 microversion: 2.1 time: 0.167009 Jul 22 22:19:24.946780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 450/872] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:24 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:19:25.953127 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9d55b5fb-deba-4800-9815-8ff07c074e80 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:25.953805 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9d55b5fb-deba-4800-9815-8ff07c074e80 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:25.959886 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9d55b5fb-deba-4800-9815-8ff07c074e80 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:25.960353 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9d55b5fb-deba-4800-9815-8ff07c074e80 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:25.961193 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9d55b5fb-deba-4800-9815-8ff07c074e80 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:25.961619 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9d55b5fb-deba-4800-9815-8ff07c074e80 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:25.966750 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ea7bda46-52e4-4ba6-99f3-646e9c94d938 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:25.967564 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ea7bda46-52e4-4ba6-99f3-646e9c94d938 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:25.974191 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea7bda46-52e4-4ba6-99f3-646e9c94d938 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:25.974691 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea7bda46-52e4-4ba6-99f3-646e9c94d938 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:25.975548 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea7bda46-52e4-4ba6-99f3-646e9c94d938 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:25.975977 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ea7bda46-52e4-4ba6-99f3-646e9c94d938 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:26.103589 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9d55b5fb-deba-4800-9815-8ff07c074e80 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:26.110987 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9d55b5fb-deba-4800-9815-8ff07c074e80 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1661 microversion: 2.1 time: 0.161932 Jul 22 22:19:26.111548 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 423/873] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:25 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1661 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:26.120649 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ea7bda46-52e4-4ba6-99f3-646e9c94d938 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:26.128510 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9e0aeb62-8ba6-4cd6-a498-cb3ecc90feab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:19:26.130067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ea7bda46-52e4-4ba6-99f3-646e9c94d938 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1560 microversion: 2.1 time: 0.170691 Jul 22 22:19:26.130872 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 451/874] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:25 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:26.135294 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9e0aeb62-8ba6-4cd6-a498-cb3ecc90feab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:26.135738 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9e0aeb62-8ba6-4cd6-a498-cb3ecc90feab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:26.160090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9e0aeb62-8ba6-4cd6-a498-cb3ecc90feab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Going to try to start instance {{(pid=107498) start /opt/stack/nova/nova/compute/api.py:2605}} Jul 22 22:19:26.202557 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9e0aeb62-8ba6-4cd6-a498-cb3ecc90feab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action" status: 202 len: 0 microversion: 2.1 time: 0.077665 Jul 22 22:19:26.203203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 424/875] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:19:26 2021] POST /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:19:26.211880 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-216aed1f-d29f-4046-aad9-782f46ec9406 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:26.212544 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-216aed1f-d29f-4046-aad9-782f46ec9406 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:26.218696 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-216aed1f-d29f-4046-aad9-782f46ec9406 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:26.219143 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-216aed1f-d29f-4046-aad9-782f46ec9406 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:26.219915 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-216aed1f-d29f-4046-aad9-782f46ec9406 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:26.220381 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-216aed1f-d29f-4046-aad9-782f46ec9406 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:26.375196 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-216aed1f-d29f-4046-aad9-782f46ec9406 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:26.383595 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-216aed1f-d29f-4046-aad9-782f46ec9406 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1670 microversion: 2.1 time: 0.175378 Jul 22 22:19:26.384796 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 452/876] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:26 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:19:26.570909 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:19:26.571117 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: Thu Jul 22 22:19:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:19:27.152105 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-eaab2a15-d72c-4c2e-9dc7-16a10807bdb2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:27.152838 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-eaab2a15-d72c-4c2e-9dc7-16a10807bdb2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:27.159126 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eaab2a15-d72c-4c2e-9dc7-16a10807bdb2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:27.159699 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eaab2a15-d72c-4c2e-9dc7-16a10807bdb2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:27.160538 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eaab2a15-d72c-4c2e-9dc7-16a10807bdb2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:27.160977 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eaab2a15-d72c-4c2e-9dc7-16a10807bdb2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:27.306465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-eaab2a15-d72c-4c2e-9dc7-16a10807bdb2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:27.314551 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-eaab2a15-d72c-4c2e-9dc7-16a10807bdb2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1560 microversion: 2.1 time: 0.169430 Jul 22 22:19:27.315288 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 425/877] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:27 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:27.401899 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-24aece09-8a16-4bf4-87f1-c49273db5803 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:27.402546 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-24aece09-8a16-4bf4-87f1-c49273db5803 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:27.408243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24aece09-8a16-4bf4-87f1-c49273db5803 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:27.409361 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24aece09-8a16-4bf4-87f1-c49273db5803 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:27.410119 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24aece09-8a16-4bf4-87f1-c49273db5803 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:27.410545 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-24aece09-8a16-4bf4-87f1-c49273db5803 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:27.555736 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-24aece09-8a16-4bf4-87f1-c49273db5803 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:27.564039 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-24aece09-8a16-4bf4-87f1-c49273db5803 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1670 microversion: 2.1 time: 0.165785 Jul 22 22:19:27.564855 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 453/878] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:27 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:28.332684 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-61361423-5ea2-4d40-b1a7-32b1a37129dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:28.333304 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-61361423-5ea2-4d40-b1a7-32b1a37129dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:28.339247 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-61361423-5ea2-4d40-b1a7-32b1a37129dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:28.339957 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-61361423-5ea2-4d40-b1a7-32b1a37129dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:28.340756 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-61361423-5ea2-4d40-b1a7-32b1a37129dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:28.341195 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-61361423-5ea2-4d40-b1a7-32b1a37129dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:28.477838 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-61361423-5ea2-4d40-b1a7-32b1a37129dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:28.486139 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-61361423-5ea2-4d40-b1a7-32b1a37129dc tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1566 microversion: 2.1 time: 0.158071 Jul 22 22:19:28.486935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 426/879] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:28 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:28.562364 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7160a86b-e695-4b31-8bf2-77dde365db49 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:28.562906 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7160a86b-e695-4b31-8bf2-77dde365db49 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:28.569302 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7160a86b-e695-4b31-8bf2-77dde365db49 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:28.569751 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7160a86b-e695-4b31-8bf2-77dde365db49 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:28.570514 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7160a86b-e695-4b31-8bf2-77dde365db49 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:28.570945 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7160a86b-e695-4b31-8bf2-77dde365db49 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:28.583563 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-35a96ea9-3925-4b38-8ca1-cd365f9eb35c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:28.584157 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-35a96ea9-3925-4b38-8ca1-cd365f9eb35c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:28.590158 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-35a96ea9-3925-4b38-8ca1-cd365f9eb35c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:28.590629 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-35a96ea9-3925-4b38-8ca1-cd365f9eb35c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:28.591419 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-35a96ea9-3925-4b38-8ca1-cd365f9eb35c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:28.591863 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-35a96ea9-3925-4b38-8ca1-cd365f9eb35c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:28.661353 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-7160a86b-e695-4b31-8bf2-77dde365db49 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lazy-loading 'services' on Instance uuid c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:19:28.730765 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7160a86b-e695-4b31-8bf2-77dde365db49 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "DELETE /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/os-volume_attachments/eaf9284e-fb77-4265-8628-8b5de92d43a1" status: 202 len: 0 microversion: 2.1 time: 0.172014 Jul 22 22:19:28.731599 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 454/880] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:19:28 2021] DELETE /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae/os-volume_attachments/eaf9284e-fb77-4265-8628-8b5de92d43a1 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:19:28.736538 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-35a96ea9-3925-4b38-8ca1-cd365f9eb35c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:28.744942 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-35a96ea9-3925-4b38-8ca1-cd365f9eb35c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1674 microversion: 2.1 time: 0.166103 Jul 22 22:19:28.745517 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 427/881] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:28 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1674 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:19:33.195431 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4f9b1a7f-7e14-4ab8-a41e-2f4233675635 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:33.196127 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4f9b1a7f-7e14-4ab8-a41e-2f4233675635 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:33.202370 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4f9b1a7f-7e14-4ab8-a41e-2f4233675635 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:33.202819 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4f9b1a7f-7e14-4ab8-a41e-2f4233675635 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:33.203622 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4f9b1a7f-7e14-4ab8-a41e-2f4233675635 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:33.204051 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4f9b1a7f-7e14-4ab8-a41e-2f4233675635 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:33.234476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4f9b1a7f-7e14-4ab8-a41e-2f4233675635 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Going to try to terminate instance {{(pid=107499) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:19:33.318890 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4f9b1a7f-7e14-4ab8-a41e-2f4233675635 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "DELETE /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 204 len: 0 microversion: 2.1 time: 0.127572 Jul 22 22:19:33.322315 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 455/882] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:19:33 2021] DELETE /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:19:33.327530 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7b388c1f-fc31-4cbf-9a9f-9863e6e06318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:33.328114 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7b388c1f-fc31-4cbf-9a9f-9863e6e06318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:33.335364 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b388c1f-fc31-4cbf-9a9f-9863e6e06318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:33.335801 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b388c1f-fc31-4cbf-9a9f-9863e6e06318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:33.336650 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b388c1f-fc31-4cbf-9a9f-9863e6e06318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:33.337336 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7b388c1f-fc31-4cbf-9a9f-9863e6e06318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:33.481972 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7b388c1f-fc31-4cbf-9a9f-9863e6e06318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:33.490356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7b388c1f-fc31-4cbf-9a9f-9863e6e06318 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1511 microversion: 2.1 time: 0.166680 Jul 22 22:19:33.490931 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 428/883] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:33 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:34.508344 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1ace2ff0-4a9b-40d4-b937-2fc4faa1359e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:34.509060 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1ace2ff0-4a9b-40d4-b937-2fc4faa1359e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:34.515145 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1ace2ff0-4a9b-40d4-b937-2fc4faa1359e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:34.515593 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1ace2ff0-4a9b-40d4-b937-2fc4faa1359e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:34.516384 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1ace2ff0-4a9b-40d4-b937-2fc4faa1359e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:34.516833 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1ace2ff0-4a9b-40d4-b937-2fc4faa1359e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:34.657069 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1ace2ff0-4a9b-40d4-b937-2fc4faa1359e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:34.665154 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1ace2ff0-4a9b-40d4-b937-2fc4faa1359e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1511 microversion: 2.1 time: 0.161669 Jul 22 22:19:34.665723 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 456/884] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:34 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:35.681854 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-360b59c7-f10e-4ad7-b782-2c42c496bbc7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:35.682468 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-360b59c7-f10e-4ad7-b782-2c42c496bbc7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:35.688441 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-360b59c7-f10e-4ad7-b782-2c42c496bbc7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:35.688893 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-360b59c7-f10e-4ad7-b782-2c42c496bbc7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:35.689664 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-360b59c7-f10e-4ad7-b782-2c42c496bbc7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:35.690099 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-360b59c7-f10e-4ad7-b782-2c42c496bbc7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:35.823975 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-360b59c7-f10e-4ad7-b782-2c42c496bbc7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:35.831151 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-360b59c7-f10e-4ad7-b782-2c42c496bbc7 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1511 microversion: 2.1 time: 0.152997 Jul 22 22:19:35.831696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 429/885] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:35 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:36.848601 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8baf5922-ac56-40e0-a13f-c80a7da96ea3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:36.849634 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8baf5922-ac56-40e0-a13f-c80a7da96ea3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:36.856227 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8baf5922-ac56-40e0-a13f-c80a7da96ea3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:36.856794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8baf5922-ac56-40e0-a13f-c80a7da96ea3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:36.857559 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8baf5922-ac56-40e0-a13f-c80a7da96ea3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:36.858002 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8baf5922-ac56-40e0-a13f-c80a7da96ea3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:36.999106 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8baf5922-ac56-40e0-a13f-c80a7da96ea3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:37.006364 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8baf5922-ac56-40e0-a13f-c80a7da96ea3 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1511 microversion: 2.1 time: 0.162289 Jul 22 22:19:37.006932 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 457/886] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:36 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:38.023304 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b84b3631-2bd6-4c3c-b73d-a8a195ce7124 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:38.023924 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b84b3631-2bd6-4c3c-b73d-a8a195ce7124 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:38.030023 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b84b3631-2bd6-4c3c-b73d-a8a195ce7124 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:38.030472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b84b3631-2bd6-4c3c-b73d-a8a195ce7124 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:38.031247 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b84b3631-2bd6-4c3c-b73d-a8a195ce7124 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:38.031679 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b84b3631-2bd6-4c3c-b73d-a8a195ce7124 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:38.198159 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b84b3631-2bd6-4c3c-b73d-a8a195ce7124 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:38.206218 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b84b3631-2bd6-4c3c-b73d-a8a195ce7124 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1511 microversion: 2.1 time: 0.187124 Jul 22 22:19:38.206988 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 430/887] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:38 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:38.724688 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-58f9e1cb-b40e-4062-9b92-41829959fc1e req-a1bf490d-a940-4d99-89e5-408731f50033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b32a316-01f1-4ac2-9c15-708742d4afac", "name": "network-vif-deleted", "tag": "78cc8d65-ba06-4a10-a7de-a5a8599859dd"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:19:38.727052 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:19:38.727052 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:19:38.735644 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-58f9e1cb-b40e-4062-9b92-41829959fc1e req-a1bf490d-a940-4d99-89e5-408731f50033 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:38.736213 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-58f9e1cb-b40e-4062-9b92-41829959fc1e req-a1bf490d-a940-4d99-89e5-408731f50033 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:38.750115 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-58f9e1cb-b40e-4062-9b92-41829959fc1e req-a1bf490d-a940-4d99-89e5-408731f50033 service nova] Creating event network-vif-deleted:78cc8d65-ba06-4a10-a7de-a5a8599859dd for instance 2b32a316-01f1-4ac2-9c15-708742d4afac on hv-cinder-80186 Jul 22 22:19:38.755771 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-58f9e1cb-b40e-4062-9b92-41829959fc1e req-a1bf490d-a940-4d99-89e5-408731f50033 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251792 Jul 22 22:19:38.756593 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 458/888] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:19:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:19:39.224190 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-00f3b00a-f98e-4e29-a756-fcd1c524b2f1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:39.224847 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-00f3b00a-f98e-4e29-a756-fcd1c524b2f1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:39.230863 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-00f3b00a-f98e-4e29-a756-fcd1c524b2f1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:39.231312 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-00f3b00a-f98e-4e29-a756-fcd1c524b2f1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:39.232088 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-00f3b00a-f98e-4e29-a756-fcd1c524b2f1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:39.232547 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-00f3b00a-f98e-4e29-a756-fcd1c524b2f1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:39.274863 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-00f3b00a-f98e-4e29-a756-fcd1c524b2f1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:39.275315 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-00f3b00a-f98e-4e29-a756-fcd1c524b2f1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:39.275772 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.objects.instance [None req-00f3b00a-f98e-4e29-a756-fcd1c524b2f1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lazy-loading 'fault' on Instance uuid 2b32a316-01f1-4ac2-9c15-708742d4afac {{(pid=107498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:19:39.325726 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-00f3b00a-f98e-4e29-a756-fcd1c524b2f1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:39.334431 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-00f3b00a-f98e-4e29-a756-fcd1c524b2f1 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 200 len: 1315 microversion: 2.1 time: 0.114505 Jul 22 22:19:39.344375 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 431/889] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:39 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 1315 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:40.352300 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4cd06954-b584-4ab9-9d6d-57b4b3b5dc2a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:40.352987 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4cd06954-b584-4ab9-9d6d-57b4b3b5dc2a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: 2b32a316-01f1-4ac2-9c15-708742d4afac] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:40.358882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4cd06954-b584-4ab9-9d6d-57b4b3b5dc2a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:40.359321 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4cd06954-b584-4ab9-9d6d-57b4b3b5dc2a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:40.360073 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4cd06954-b584-4ab9-9d6d-57b4b3b5dc2a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:40.360536 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4cd06954-b584-4ab9-9d6d-57b4b3b5dc2a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:40.374120 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-4cd06954-b584-4ab9-9d6d-57b4b3b5dc2a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] HTTP exception thrown: Instance 2b32a316-01f1-4ac2-9c15-708742d4afac could not be found. Jul 22 22:19:40.374676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4cd06954-b584-4ab9-9d6d-57b4b3b5dc2a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Returning 404 to user: Instance 2b32a316-01f1-4ac2-9c15-708742d4afac could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:19:40.375483 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4cd06954-b584-4ab9-9d6d-57b4b3b5dc2a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac" status: 404 len: 111 microversion: 2.1 time: 0.027257 Jul 22 22:19:40.376012 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 459/890] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:40 2021] GET /compute/v2.1/servers/2b32a316-01f1-4ac2-9c15-708742d4afac => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:19:40.384744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cd543165-20cf-4735-8027-48594abc17ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:40.385241 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cd543165-20cf-4735-8027-48594abc17ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:40.390974 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cd543165-20cf-4735-8027-48594abc17ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:40.391415 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cd543165-20cf-4735-8027-48594abc17ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:40.392171 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cd543165-20cf-4735-8027-48594abc17ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:40.392631 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cd543165-20cf-4735-8027-48594abc17ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:40.416572 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cd543165-20cf-4735-8027-48594abc17ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:19:40.493149 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cd543165-20cf-4735-8027-48594abc17ef tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "DELETE /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 204 len: 0 microversion: 2.1 time: 0.111603 Jul 22 22:19:40.493648 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 432/891] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:19:40 2021] DELETE /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:19:40.502891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8b868395-502a-43be-b1d9-92281f4e59a2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:40.504097 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8b868395-502a-43be-b1d9-92281f4e59a2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:40.510078 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b868395-502a-43be-b1d9-92281f4e59a2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:40.510567 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b868395-502a-43be-b1d9-92281f4e59a2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:40.511343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b868395-502a-43be-b1d9-92281f4e59a2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:40.511772 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b868395-502a-43be-b1d9-92281f4e59a2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:40.651289 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8b868395-502a-43be-b1d9-92281f4e59a2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:40.658862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8b868395-502a-43be-b1d9-92281f4e59a2 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.159658 Jul 22 22:19:40.659745 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 460/892] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:40 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:41.681942 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8cd79d67-9a5c-471e-a5f8-3c787793ea2e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:41.683399 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8cd79d67-9a5c-471e-a5f8-3c787793ea2e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:41.689222 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8cd79d67-9a5c-471e-a5f8-3c787793ea2e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:41.689672 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8cd79d67-9a5c-471e-a5f8-3c787793ea2e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:41.690446 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8cd79d67-9a5c-471e-a5f8-3c787793ea2e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:41.691619 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8cd79d67-9a5c-471e-a5f8-3c787793ea2e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:41.859942 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8cd79d67-9a5c-471e-a5f8-3c787793ea2e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:41.867593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8cd79d67-9a5c-471e-a5f8-3c787793ea2e tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.189760 Jul 22 22:19:41.868149 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 433/893] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:41 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:42.885356 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-117ea6b9-4de7-478f-965f-f363caade7fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:42.885824 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-117ea6b9-4de7-478f-965f-f363caade7fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:42.891518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-117ea6b9-4de7-478f-965f-f363caade7fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:42.891966 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-117ea6b9-4de7-478f-965f-f363caade7fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:42.892776 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-117ea6b9-4de7-478f-965f-f363caade7fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:42.893215 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-117ea6b9-4de7-478f-965f-f363caade7fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:43.044248 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-117ea6b9-4de7-478f-965f-f363caade7fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:43.051916 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-117ea6b9-4de7-478f-965f-f363caade7fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.170346 Jul 22 22:19:43.052611 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 461/894] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:42 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:44.069222 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8387ee76-1c98-49cb-95b2-cda99324255f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:44.069840 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8387ee76-1c98-49cb-95b2-cda99324255f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:44.076792 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8387ee76-1c98-49cb-95b2-cda99324255f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:44.077230 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8387ee76-1c98-49cb-95b2-cda99324255f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:44.078009 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8387ee76-1c98-49cb-95b2-cda99324255f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:44.078558 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8387ee76-1c98-49cb-95b2-cda99324255f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:44.248675 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8387ee76-1c98-49cb-95b2-cda99324255f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:44.257015 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8387ee76-1c98-49cb-95b2-cda99324255f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.191610 Jul 22 22:19:44.257582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 434/895] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:44 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:45.249048 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c2cc0f96-4078-427b-b7bd-6ca6a6b2e254 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1320368380"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:19:45.249586 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c2cc0f96-4078-427b-b7bd-6ca6a6b2e254 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:45.256310 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c2cc0f96-4078-427b-b7bd-6ca6a6b2e254 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:45.256750 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c2cc0f96-4078-427b-b7bd-6ca6a6b2e254 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:45.257636 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c2cc0f96-4078-427b-b7bd-6ca6a6b2e254 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:45.257978 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c2cc0f96-4078-427b-b7bd-6ca6a6b2e254 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:45.275981 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-170531eb-5680-4d50-8ad1-6a4324dee003 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:45.276806 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-170531eb-5680-4d50-8ad1-6a4324dee003 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:45.286130 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-170531eb-5680-4d50-8ad1-6a4324dee003 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:45.286935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-170531eb-5680-4d50-8ad1-6a4324dee003 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:45.288575 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-170531eb-5680-4d50-8ad1-6a4324dee003 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:45.289133 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-170531eb-5680-4d50-8ad1-6a4324dee003 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:45.405042 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.network.security_group_api [None req-c2cc0f96-4078-427b-b7bd-6ca6a6b2e254 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Removing security group 88ee5899-9ada-4827-b2ff-6ac184c120bc from port c19590f0-00b8-4111-9a00-68a6160feb39 Jul 22 22:19:45.450283 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-170531eb-5680-4d50-8ad1-6a4324dee003 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:45.465289 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-170531eb-5680-4d50-8ad1-6a4324dee003 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.186958 Jul 22 22:19:45.465289 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 435/896] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:45 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:45.808306 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c2cc0f96-4078-427b-b7bd-6ca6a6b2e254 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "POST /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/action" status: 202 len: 0 microversion: 2.1 time: 0.562859 Jul 22 22:19:45.809043 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 462/897] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:19:45 2021] POST /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:19:45.821301 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-eb908a7c-bd80-426d-8116-346f24a03b80 req-043ab2b5-1615-4ced-b4e4-335988ed0163 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cddea8-25f9-440b-86f2-dd9c49130770", "tag": "c19590f0-00b8-4111-9a00-68a6160feb39"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:19:45.822882 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:19:45.822882 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:19:45.830230 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-eb908a7c-bd80-426d-8116-346f24a03b80 req-043ab2b5-1615-4ced-b4e4-335988ed0163 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:45.830634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-eb908a7c-bd80-426d-8116-346f24a03b80 req-043ab2b5-1615-4ced-b4e4-335988ed0163 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:45.854271 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-eb908a7c-bd80-426d-8116-346f24a03b80 req-043ab2b5-1615-4ced-b4e4-335988ed0163 service nova] Creating event network-changed:c19590f0-00b8-4111-9a00-68a6160feb39 for instance e8cddea8-25f9-440b-86f2-dd9c49130770 on hv-cinder-80186 Jul 22 22:19:45.866818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-eb908a7c-bd80-426d-8116-346f24a03b80 req-043ab2b5-1615-4ced-b4e4-335988ed0163 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048338 Jul 22 22:19:45.870748 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 436/898] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:19:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:19:46.478271 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-dde51456-08e7-40c8-a2cf-3e95cec18f67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:46.479016 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-dde51456-08e7-40c8-a2cf-3e95cec18f67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:46.486430 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dde51456-08e7-40c8-a2cf-3e95cec18f67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:46.486959 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dde51456-08e7-40c8-a2cf-3e95cec18f67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:46.488524 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dde51456-08e7-40c8-a2cf-3e95cec18f67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:46.489055 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dde51456-08e7-40c8-a2cf-3e95cec18f67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:46.735809 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-dde51456-08e7-40c8-a2cf-3e95cec18f67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:46.744267 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-dde51456-08e7-40c8-a2cf-3e95cec18f67 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.269873 Jul 22 22:19:46.760391 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 463/899] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:46 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:47.187927 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f7330a6d-7c77-4d5c-9871-cc6cf13bd18f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:47.188590 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f7330a6d-7c77-4d5c-9871-cc6cf13bd18f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:47.195903 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f7330a6d-7c77-4d5c-9871-cc6cf13bd18f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:47.196310 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f7330a6d-7c77-4d5c-9871-cc6cf13bd18f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:47.197135 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f7330a6d-7c77-4d5c-9871-cc6cf13bd18f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:47.197593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f7330a6d-7c77-4d5c-9871-cc6cf13bd18f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:47.236725 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f7330a6d-7c77-4d5c-9871-cc6cf13bd18f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/os-volume_attachments/82ca9a69-c7bc-463d-bee5-7c434ad20a8f" status: 200 len: 194 microversion: 2.20 time: 0.220450 Jul 22 22:19:47.237444 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 437/900] 10.222.0.110 () {60 vars in 1459 bytes} [Thu Jul 22 22:19:47 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/os-volume_attachments/82ca9a69-c7bc-463d-bee5-7c434ad20a8f => generated 194 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:19:47.238027 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f7af68e2-8be3-4463-8b07-f0572b426f82 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:47.238717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f7af68e2-8be3-4463-8b07-f0572b426f82 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:47.245873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f7af68e2-8be3-4463-8b07-f0572b426f82 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:47.245973 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f7af68e2-8be3-4463-8b07-f0572b426f82 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:47.246676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f7af68e2-8be3-4463-8b07-f0572b426f82 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:47.247102 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f7af68e2-8be3-4463-8b07-f0572b426f82 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:47.328128 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-abdbf137-3a9c-49f1-a728-d914e79ebf6e req-15f0f03e-ecff-4809-abe8-3312a0a159a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8cddea8-25f9-440b-86f2-dd9c49130770", "tag": "c19590f0-00b8-4111-9a00-68a6160feb39"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:19:47.330247 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:19:47.330247 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:19:47.338655 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-abdbf137-3a9c-49f1-a728-d914e79ebf6e req-15f0f03e-ecff-4809-abe8-3312a0a159a6 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:47.339216 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-abdbf137-3a9c-49f1-a728-d914e79ebf6e req-15f0f03e-ecff-4809-abe8-3312a0a159a6 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:47.352924 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-abdbf137-3a9c-49f1-a728-d914e79ebf6e req-15f0f03e-ecff-4809-abe8-3312a0a159a6 service nova] Creating event network-changed:c19590f0-00b8-4111-9a00-68a6160feb39 for instance e8cddea8-25f9-440b-86f2-dd9c49130770 on hv-cinder-80186 Jul 22 22:19:47.358194 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-abdbf137-3a9c-49f1-a728-d914e79ebf6e req-15f0f03e-ecff-4809-abe8-3312a0a159a6 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119163 Jul 22 22:19:47.358875 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 438/901] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:19:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:19:47.359333 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-f7af68e2-8be3-4463-8b07-f0572b426f82 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lazy-loading 'services' on Instance uuid e8cddea8-25f9-440b-86f2-dd9c49130770 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:19:47.366362 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a7d640af-bd7c-4fa5-bda7-0c7e12a67947 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:47.367041 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a7d640af-bd7c-4fa5-bda7-0c7e12a67947 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:47.373296 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a7d640af-bd7c-4fa5-bda7-0c7e12a67947 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:47.373821 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a7d640af-bd7c-4fa5-bda7-0c7e12a67947 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:47.374937 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a7d640af-bd7c-4fa5-bda7-0c7e12a67947 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:47.375470 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a7d640af-bd7c-4fa5-bda7-0c7e12a67947 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:47.434694 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f7af68e2-8be3-4463-8b07-f0572b426f82 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "DELETE /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments/7031506c-04e5-4699-b7ca-4f07339d2573" status: 202 len: 0 microversion: 2.1 time: 0.200481 Jul 22 22:19:47.438084 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 464/902] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:19:47 2021] DELETE /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments/7031506c-04e5-4699-b7ca-4f07339d2573 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:19:47.445856 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ce97012d-73e7-48a2-995e-7760383c2d8e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:47.447348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ce97012d-73e7-48a2-995e-7760383c2d8e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:47.454555 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ce97012d-73e7-48a2-995e-7760383c2d8e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:47.455120 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ce97012d-73e7-48a2-995e-7760383c2d8e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:47.456737 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ce97012d-73e7-48a2-995e-7760383c2d8e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:47.457557 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ce97012d-73e7-48a2-995e-7760383c2d8e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:47.494652 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ce97012d-73e7-48a2-995e-7760383c2d8e tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053863 Jul 22 22:19:47.496382 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 465/903] 10.222.0.110 () {58 vars in 1307 bytes} [Thu Jul 22 22:19:47 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:19:47.505215 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.objects.instance [None req-a7d640af-bd7c-4fa5-bda7-0c7e12a67947 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lazy-loading 'services' on Instance uuid 61e7dd91-3f55-48c9-85aa-84c2450719f2 {{(pid=107498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:19:47.575689 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a7d640af-bd7c-4fa5-bda7-0c7e12a67947 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "DELETE /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/os-volume_attachments/82ca9a69-c7bc-463d-bee5-7c434ad20a8f" status: 202 len: 0 microversion: 2.20 time: 0.214987 Jul 22 22:19:47.576487 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 439/904] 10.222.0.110 () {60 vars in 1462 bytes} [Thu Jul 22 22:19:47 2021] DELETE /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2/os-volume_attachments/82ca9a69-c7bc-463d-bee5-7c434ad20a8f => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:19:47.766804 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b1bb198c-5dfa-4ab0-b27d-b4e2341a21fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:47.767433 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b1bb198c-5dfa-4ab0-b27d-b4e2341a21fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:47.774027 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1bb198c-5dfa-4ab0-b27d-b4e2341a21fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:47.774472 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1bb198c-5dfa-4ab0-b27d-b4e2341a21fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:47.775245 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1bb198c-5dfa-4ab0-b27d-b4e2341a21fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:47.775676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1bb198c-5dfa-4ab0-b27d-b4e2341a21fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:47.918150 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b1bb198c-5dfa-4ab0-b27d-b4e2341a21fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:47.926475 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b1bb198c-5dfa-4ab0-b27d-b4e2341a21fd tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.163407 Jul 22 22:19:47.927052 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 466/905] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:47 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:48.508875 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b5ad3607-f742-42c3-9bac-ed06953d48fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:48.509808 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b5ad3607-f742-42c3-9bac-ed06953d48fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:48.515876 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b5ad3607-f742-42c3-9bac-ed06953d48fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:48.516362 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b5ad3607-f742-42c3-9bac-ed06953d48fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:48.517140 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b5ad3607-f742-42c3-9bac-ed06953d48fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:48.517581 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b5ad3607-f742-42c3-9bac-ed06953d48fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:48.547265 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b5ad3607-f742-42c3-9bac-ed06953d48fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043178 Jul 22 22:19:48.547822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 440/906] 10.222.0.110 () {58 vars in 1307 bytes} [Thu Jul 22 22:19:48 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:19:48.943526 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-76384bf9-7f05-4cc4-8a04-7bcf646cd1f0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:48.944149 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-76384bf9-7f05-4cc4-8a04-7bcf646cd1f0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:48.950010 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76384bf9-7f05-4cc4-8a04-7bcf646cd1f0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:48.950449 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76384bf9-7f05-4cc4-8a04-7bcf646cd1f0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:48.951199 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76384bf9-7f05-4cc4-8a04-7bcf646cd1f0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:48.951625 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-76384bf9-7f05-4cc4-8a04-7bcf646cd1f0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:49.100917 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-76384bf9-7f05-4cc4-8a04-7bcf646cd1f0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:49.108201 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-76384bf9-7f05-4cc4-8a04-7bcf646cd1f0 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.169215 Jul 22 22:19:49.108789 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 467/907] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:48 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:49.559120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8165f2d0-9945-49c7-b847-56e1f5aa974a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:49.560034 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8165f2d0-9945-49c7-b847-56e1f5aa974a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:49.566993 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8165f2d0-9945-49c7-b847-56e1f5aa974a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:49.567439 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8165f2d0-9945-49c7-b847-56e1f5aa974a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:49.568216 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8165f2d0-9945-49c7-b847-56e1f5aa974a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:49.568678 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8165f2d0-9945-49c7-b847-56e1f5aa974a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:49.597612 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8165f2d0-9945-49c7-b847-56e1f5aa974a tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042378 Jul 22 22:19:49.598185 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 441/908] 10.222.0.110 () {58 vars in 1307 bytes} [Thu Jul 22 22:19:49 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:19:50.124668 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ead7c470-dcc2-4d4a-a869-3f475101d109 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:50.125248 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ead7c470-dcc2-4d4a-a869-3f475101d109 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:50.132056 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ead7c470-dcc2-4d4a-a869-3f475101d109 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:50.132524 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ead7c470-dcc2-4d4a-a869-3f475101d109 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:50.133288 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ead7c470-dcc2-4d4a-a869-3f475101d109 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:50.133720 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ead7c470-dcc2-4d4a-a869-3f475101d109 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:50.273088 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ead7c470-dcc2-4d4a-a869-3f475101d109 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:50.280619 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ead7c470-dcc2-4d4a-a869-3f475101d109 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.159505 Jul 22 22:19:50.281182 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 468/909] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:50 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:50.609318 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4ae07189-b34b-42f6-9a9a-ad76bc9b10d5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:50.610229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4ae07189-b34b-42f6-9a9a-ad76bc9b10d5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:50.616964 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ae07189-b34b-42f6-9a9a-ad76bc9b10d5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:50.617410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ae07189-b34b-42f6-9a9a-ad76bc9b10d5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:50.618171 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ae07189-b34b-42f6-9a9a-ad76bc9b10d5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:50.618603 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ae07189-b34b-42f6-9a9a-ad76bc9b10d5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:50.647160 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4ae07189-b34b-42f6-9a9a-ad76bc9b10d5 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041581 Jul 22 22:19:50.647709 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 442/910] 10.222.0.110 () {58 vars in 1307 bytes} [Thu Jul 22 22:19:50 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:19:51.297892 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ef34082b-512f-49fc-851e-c9babd068288 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:51.298511 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ef34082b-512f-49fc-851e-c9babd068288 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:51.305024 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ef34082b-512f-49fc-851e-c9babd068288 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:51.305467 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ef34082b-512f-49fc-851e-c9babd068288 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:51.306285 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ef34082b-512f-49fc-851e-c9babd068288 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:51.306842 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ef34082b-512f-49fc-851e-c9babd068288 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:51.529538 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ef34082b-512f-49fc-851e-c9babd068288 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:51.537611 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ef34082b-512f-49fc-851e-c9babd068288 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.243280 Jul 22 22:19:51.538418 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 469/911] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:51 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:51.756627 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-37bbc71e-d8c8-4791-a08d-239abbe19a31 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:51.757539 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-37bbc71e-d8c8-4791-a08d-239abbe19a31 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:51.763433 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-37bbc71e-d8c8-4791-a08d-239abbe19a31 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:51.763887 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-37bbc71e-d8c8-4791-a08d-239abbe19a31 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:51.764682 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-37bbc71e-d8c8-4791-a08d-239abbe19a31 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:51.765123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-37bbc71e-d8c8-4791-a08d-239abbe19a31 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:51.795788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-37bbc71e-d8c8-4791-a08d-239abbe19a31 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140856 Jul 22 22:19:51.796363 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 443/912] 10.222.0.110 () {58 vars in 1307 bytes} [Thu Jul 22 22:19:51 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:19:52.554600 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-cb3a0d28-aa3c-4609-abf7-f14ebb3b8a39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:52.555352 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-cb3a0d28-aa3c-4609-abf7-f14ebb3b8a39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:52.561991 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cb3a0d28-aa3c-4609-abf7-f14ebb3b8a39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:52.562435 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cb3a0d28-aa3c-4609-abf7-f14ebb3b8a39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:52.563386 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cb3a0d28-aa3c-4609-abf7-f14ebb3b8a39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:52.563843 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cb3a0d28-aa3c-4609-abf7-f14ebb3b8a39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:52.715812 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-cb3a0d28-aa3c-4609-abf7-f14ebb3b8a39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:52.723886 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-cb3a0d28-aa3c-4609-abf7-f14ebb3b8a39 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.172982 Jul 22 22:19:52.724475 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 470/913] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:52 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:52.807429 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8635d620-1181-4b5d-94b8-bcf1d21656a6 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:52.808350 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8635d620-1181-4b5d-94b8-bcf1d21656a6 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:52.814123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8635d620-1181-4b5d-94b8-bcf1d21656a6 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:52.814565 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8635d620-1181-4b5d-94b8-bcf1d21656a6 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:52.815448 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8635d620-1181-4b5d-94b8-bcf1d21656a6 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:52.816060 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8635d620-1181-4b5d-94b8-bcf1d21656a6 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:52.845935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8635d620-1181-4b5d-94b8-bcf1d21656a6 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042264 Jul 22 22:19:52.847486 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 444/914] 10.222.0.110 () {58 vars in 1307 bytes} [Thu Jul 22 22:19:52 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:19:52.858112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-20568959-a119-45cb-a721-945824e299a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:52.858604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-20568959-a119-45cb-a721-945824e299a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:52.865385 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20568959-a119-45cb-a721-945824e299a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:52.865774 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20568959-a119-45cb-a721-945824e299a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:52.866543 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20568959-a119-45cb-a721-945824e299a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:52.866984 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-20568959-a119-45cb-a721-945824e299a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:52.947545 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-20568959-a119-45cb-a721-945824e299a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] HTTP exception thrown: Instance e8cddea8-25f9-440b-86f2-dd9c49130770 is not attached to volume 7031506c-04e5-4699-b7ca-4f07339d2573 Jul 22 22:19:52.948155 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-20568959-a119-45cb-a721-945824e299a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Returning 404 to user: Instance e8cddea8-25f9-440b-86f2-dd9c49130770 is not attached to volume 7031506c-04e5-4699-b7ca-4f07339d2573 {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:19:52.949018 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-20568959-a119-45cb-a721-945824e299a3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "DELETE /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments/7031506c-04e5-4699-b7ca-4f07339d2573" status: 404 len: 154 microversion: 2.1 time: 0.094950 Jul 22 22:19:52.949621 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 471/915] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:19:52 2021] DELETE /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770/os-volume_attachments/7031506c-04e5-4699-b7ca-4f07339d2573 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 22:19:53.741660 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f2997aac-a791-43d6-963b-8b2e67b9fb10 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:53.742270 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f2997aac-a791-43d6-963b-8b2e67b9fb10 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:53.748021 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f2997aac-a791-43d6-963b-8b2e67b9fb10 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:53.748510 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f2997aac-a791-43d6-963b-8b2e67b9fb10 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:53.749290 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f2997aac-a791-43d6-963b-8b2e67b9fb10 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:53.749722 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f2997aac-a791-43d6-963b-8b2e67b9fb10 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:53.907976 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f2997aac-a791-43d6-963b-8b2e67b9fb10 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:53.916193 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f2997aac-a791-43d6-963b-8b2e67b9fb10 tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1526 microversion: 2.1 time: 0.179554 Jul 22 22:19:53.916910 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 445/916] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:53 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1526 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:54.007704 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0de8171f-46a4-4c1d-99c3-58dc17ea9cb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:54.008329 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0de8171f-46a4-4c1d-99c3-58dc17ea9cb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:54.014015 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0de8171f-46a4-4c1d-99c3-58dc17ea9cb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:54.014459 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0de8171f-46a4-4c1d-99c3-58dc17ea9cb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:54.015221 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0de8171f-46a4-4c1d-99c3-58dc17ea9cb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:54.015652 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0de8171f-46a4-4c1d-99c3-58dc17ea9cb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:54.041116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0de8171f-46a4-4c1d-99c3-58dc17ea9cb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Going to try to terminate instance {{(pid=107499) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:19:54.085343 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ebf258f3-a71d-438f-9d8c-a255415579ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:54.085832 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ebf258f3-a71d-438f-9d8c-a255415579ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:54.092349 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ebf258f3-a71d-438f-9d8c-a255415579ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:54.092800 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ebf258f3-a71d-438f-9d8c-a255415579ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:54.093612 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ebf258f3-a71d-438f-9d8c-a255415579ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:54.094051 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ebf258f3-a71d-438f-9d8c-a255415579ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:54.119920 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ebf258f3-a71d-438f-9d8c-a255415579ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:19:54.130256 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0de8171f-46a4-4c1d-99c3-58dc17ea9cb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "DELETE /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 204 len: 0 microversion: 2.20 time: 0.126226 Jul 22 22:19:54.130854 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 472/917] 10.222.0.110 () {60 vars in 1285 bytes} [Thu Jul 22 22:19:54 2021] DELETE /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 22 22:19:54.139381 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-43039190-c686-4338-b0c2-0d08535a7311 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:54.140060 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-43039190-c686-4338-b0c2-0d08535a7311 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:54.147043 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-43039190-c686-4338-b0c2-0d08535a7311 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:54.147493 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-43039190-c686-4338-b0c2-0d08535a7311 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:54.148305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-43039190-c686-4338-b0c2-0d08535a7311 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:54.148724 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-43039190-c686-4338-b0c2-0d08535a7311 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:54.198150 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ebf258f3-a71d-438f-9d8c-a255415579ec tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "DELETE /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 204 len: 0 microversion: 2.1 time: 0.117202 Jul 22 22:19:54.198732 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 446/918] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:19:54 2021] DELETE /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 22 22:19:54.207876 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-27faca4c-09b2-42d6-ac04-b0b236e599b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:54.208605 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-27faca4c-09b2-42d6-ac04-b0b236e599b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:54.214814 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-27faca4c-09b2-42d6-ac04-b0b236e599b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:54.215353 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-27faca4c-09b2-42d6-ac04-b0b236e599b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:54.216077 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-27faca4c-09b2-42d6-ac04-b0b236e599b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:54.216485 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-27faca4c-09b2-42d6-ac04-b0b236e599b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:54.339203 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-43039190-c686-4338-b0c2-0d08535a7311 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:54.347717 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-43039190-c686-4338-b0c2-0d08535a7311 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:54.349256 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-43039190-c686-4338-b0c2-0d08535a7311 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:54.350433 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-43039190-c686-4338-b0c2-0d08535a7311 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.214968 Jul 22 22:19:54.350994 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 473/919] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:19:54 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:19:54.369384 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-27faca4c-09b2-42d6-ac04-b0b236e599b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:54.377184 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-27faca4c-09b2-42d6-ac04-b0b236e599b4 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1557 microversion: 2.1 time: 0.173898 Jul 22 22:19:54.378705 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 447/920] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:54 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:54.857393 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-a2bbc5f3-650f-405c-96e3-d741391a9513 req-e6307ad9-41c1-4ac0-b938-bd071aade98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae", "name": "network-vif-deleted", "tag": "4cae57e3-646c-477f-9363-d0fd4b8135a7"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:19:54.858942 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:19:54.858942 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:19:54.876912 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-a2bbc5f3-650f-405c-96e3-d741391a9513 req-e6307ad9-41c1-4ac0-b938-bd071aade98c service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:54.878259 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-a2bbc5f3-650f-405c-96e3-d741391a9513 req-e6307ad9-41c1-4ac0-b938-bd071aade98c service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:54.889883 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-a2bbc5f3-650f-405c-96e3-d741391a9513 req-e6307ad9-41c1-4ac0-b938-bd071aade98c service nova] Creating event network-vif-deleted:4cae57e3-646c-477f-9363-d0fd4b8135a7 for instance c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae on hv-cinder-80186 Jul 22 22:19:54.895345 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-a2bbc5f3-650f-405c-96e3-d741391a9513 req-e6307ad9-41c1-4ac0-b938-bd071aade98c service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041663 Jul 22 22:19:54.895937 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 474/921] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:19:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:19:54.933786 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8640fadc-2726-41a0-9e3c-8b5ebeef250a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:54.934514 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8640fadc-2726-41a0-9e3c-8b5ebeef250a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:54.946141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8640fadc-2726-41a0-9e3c-8b5ebeef250a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:54.947061 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8640fadc-2726-41a0-9e3c-8b5ebeef250a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:54.948045 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8640fadc-2726-41a0-9e3c-8b5ebeef250a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:54.948689 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8640fadc-2726-41a0-9e3c-8b5ebeef250a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:55.017318 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8640fadc-2726-41a0-9e3c-8b5ebeef250a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d31eb0bf8e34ae78249d46cc282c711', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86fc8f5aa1e84d0da9f9e144ec46978a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:55.025159 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8640fadc-2726-41a0-9e3c-8b5ebeef250a tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 200 len: 1311 microversion: 2.1 time: 0.095170 Jul 22 22:19:55.025744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 448/922] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:54 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:55.373016 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4e482747-2127-442a-ae3e-b812c0c75a11 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:55.373719 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4e482747-2127-442a-ae3e-b812c0c75a11 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:55.381119 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4e482747-2127-442a-ae3e-b812c0c75a11 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:55.381567 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4e482747-2127-442a-ae3e-b812c0c75a11 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:55.382357 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4e482747-2127-442a-ae3e-b812c0c75a11 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:55.382810 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4e482747-2127-442a-ae3e-b812c0c75a11 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:55.395932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a72d1a85-f8e6-4e24-be2b-672985df9ba3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:55.396625 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a72d1a85-f8e6-4e24-be2b-672985df9ba3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:55.402520 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a72d1a85-f8e6-4e24-be2b-672985df9ba3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:55.402978 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a72d1a85-f8e6-4e24-be2b-672985df9ba3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:55.403758 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a72d1a85-f8e6-4e24-be2b-672985df9ba3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:55.404199 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a72d1a85-f8e6-4e24-be2b-672985df9ba3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:55.543733 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4e482747-2127-442a-ae3e-b812c0c75a11 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:55.552159 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a72d1a85-f8e6-4e24-be2b-672985df9ba3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:55.559705 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a72d1a85-f8e6-4e24-be2b-672985df9ba3 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1557 microversion: 2.1 time: 0.168619 Jul 22 22:19:55.560466 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4e482747-2127-442a-ae3e-b812c0c75a11 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:55.560810 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 449/923] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:55 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:19:55.571254 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4e482747-2127-442a-ae3e-b812c0c75a11 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:55.572464 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4e482747-2127-442a-ae3e-b812c0c75a11 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.205993 Jul 22 22:19:55.573019 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 475/924] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:19:55 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:19:56.042638 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cc1352c3-e88a-4a9e-bb67-a5d178887c0f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:56.043250 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cc1352c3-e88a-4a9e-bb67-a5d178887c0f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] [instance: c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:56.050402 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc1352c3-e88a-4a9e-bb67-a5d178887c0f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:56.050532 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc1352c3-e88a-4a9e-bb67-a5d178887c0f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:56.051346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc1352c3-e88a-4a9e-bb67-a5d178887c0f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:56.051786 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc1352c3-e88a-4a9e-bb67-a5d178887c0f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:56.066343 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-cc1352c3-e88a-4a9e-bb67-a5d178887c0f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] HTTP exception thrown: Instance c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae could not be found. Jul 22 22:19:56.066993 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cc1352c3-e88a-4a9e-bb67-a5d178887c0f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] Returning 404 to user: Instance c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:19:56.067824 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cc1352c3-e88a-4a9e-bb67-a5d178887c0f tempest-ServerRescueNegativeTestJSON-863533602 tempest-ServerRescueNegativeTestJSON-863533602-project] 10.222.0.110 "GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae" status: 404 len: 111 microversion: 2.1 time: 0.028920 Jul 22 22:19:56.068394 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 450/925] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:56 2021] GET /compute/v2.1/servers/c8e1f4e9-3484-4a5b-8e3f-b2d7545944ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:19:56.577582 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4b9fb738-0281-420b-a0f2-e0c2c0c63e66 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:56.578297 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4b9fb738-0281-420b-a0f2-e0c2c0c63e66 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:56.587510 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4b9fb738-0281-420b-a0f2-e0c2c0c63e66 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:56.588421 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4b9fb738-0281-420b-a0f2-e0c2c0c63e66 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:56.589191 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4b9fb738-0281-420b-a0f2-e0c2c0c63e66 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:56.589628 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4b9fb738-0281-420b-a0f2-e0c2c0c63e66 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:56.591343 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d032fe9f-c840-4c56-91d5-c145796e3aa7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:56.591961 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d032fe9f-c840-4c56-91d5-c145796e3aa7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:56.599465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d032fe9f-c840-4c56-91d5-c145796e3aa7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:56.599921 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d032fe9f-c840-4c56-91d5-c145796e3aa7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:56.600738 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d032fe9f-c840-4c56-91d5-c145796e3aa7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:56.601174 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d032fe9f-c840-4c56-91d5-c145796e3aa7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:56.746784 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d032fe9f-c840-4c56-91d5-c145796e3aa7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:56.755265 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d032fe9f-c840-4c56-91d5-c145796e3aa7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:56.756789 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d032fe9f-c840-4c56-91d5-c145796e3aa7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:56.757932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d032fe9f-c840-4c56-91d5-c145796e3aa7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.170536 Jul 22 22:19:56.758491 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 451/926] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:19:56 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:19:56.870141 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4b9fb738-0281-420b-a0f2-e0c2c0c63e66 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:56.878524 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4b9fb738-0281-420b-a0f2-e0c2c0c63e66 tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1557 microversion: 2.1 time: 0.304891 Jul 22 22:19:56.879096 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 476/927] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:56 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1557 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:19:57.778088 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2c3dabaf-a593-463e-a896-549ba387aacd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:57.779044 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2c3dabaf-a593-463e-a896-549ba387aacd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:57.785971 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c3dabaf-a593-463e-a896-549ba387aacd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:57.786531 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c3dabaf-a593-463e-a896-549ba387aacd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:57.787636 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c3dabaf-a593-463e-a896-549ba387aacd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:57.788085 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c3dabaf-a593-463e-a896-549ba387aacd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:57.895492 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9548d8bb-790b-4fa0-8be6-ba629723c4ed tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:57.896291 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9548d8bb-790b-4fa0-8be6-ba629723c4ed tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:57.902454 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9548d8bb-790b-4fa0-8be6-ba629723c4ed tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:57.903228 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9548d8bb-790b-4fa0-8be6-ba629723c4ed tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:57.904085 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9548d8bb-790b-4fa0-8be6-ba629723c4ed tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:57.905209 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9548d8bb-790b-4fa0-8be6-ba629723c4ed tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:58.017078 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2c3dabaf-a593-463e-a896-549ba387aacd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:58.025860 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2c3dabaf-a593-463e-a896-549ba387aacd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:58.027525 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2c3dabaf-a593-463e-a896-549ba387aacd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:58.028839 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2c3dabaf-a593-463e-a896-549ba387aacd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.255228 Jul 22 22:19:58.029500 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 452/928] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:19:57 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:19:58.294885 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9548d8bb-790b-4fa0-8be6-ba629723c4ed tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ef90120c394459c89d43476995b9ea7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75448bc245984a73a936769d77050816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:58.307390 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9548d8bb-790b-4fa0-8be6-ba629723c4ed tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 200 len: 1557 microversion: 2.1 time: 0.416007 Jul 22 22:19:58.318279 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 477/929] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:57 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 1557 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:19:58.498951 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-af7b0cb8-b85b-4edb-89fc-4f055cac7266 req-929955f6-d588-43d0-90b5-b01898f2928e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8cddea8-25f9-440b-86f2-dd9c49130770", "name": "network-vif-deleted", "tag": "c19590f0-00b8-4111-9a00-68a6160feb39"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:19:58.502259 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:19:58.502259 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:19:58.513630 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-af7b0cb8-b85b-4edb-89fc-4f055cac7266 req-929955f6-d588-43d0-90b5-b01898f2928e service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:58.514071 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-af7b0cb8-b85b-4edb-89fc-4f055cac7266 req-929955f6-d588-43d0-90b5-b01898f2928e service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:58.532087 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-af7b0cb8-b85b-4edb-89fc-4f055cac7266 req-929955f6-d588-43d0-90b5-b01898f2928e service nova] Creating event network-vif-deleted:c19590f0-00b8-4111-9a00-68a6160feb39 for instance e8cddea8-25f9-440b-86f2-dd9c49130770 on hv-cinder-80186 Jul 22 22:19:58.543243 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-af7b0cb8-b85b-4edb-89fc-4f055cac7266 req-929955f6-d588-43d0-90b5-b01898f2928e service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049413 Jul 22 22:19:58.545256 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 453/930] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:19:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:19:59.048030 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ae6cdd3a-a7f7-475e-b1d6-711672d48250 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:59.050405 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ae6cdd3a-a7f7-475e-b1d6-711672d48250 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:59.056652 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae6cdd3a-a7f7-475e-b1d6-711672d48250 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:59.057494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae6cdd3a-a7f7-475e-b1d6-711672d48250 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:59.058503 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae6cdd3a-a7f7-475e-b1d6-711672d48250 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:59.059161 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ae6cdd3a-a7f7-475e-b1d6-711672d48250 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:59.327991 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-55d1946f-1126-4978-8e80-585a941e21fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:59.331810 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-55d1946f-1126-4978-8e80-585a941e21fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] [instance: e8cddea8-25f9-440b-86f2-dd9c49130770] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:19:59.340086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-55d1946f-1126-4978-8e80-585a941e21fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:59.341211 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-55d1946f-1126-4978-8e80-585a941e21fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:59.342141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-55d1946f-1126-4978-8e80-585a941e21fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:19:59.342667 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-55d1946f-1126-4978-8e80-585a941e21fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:19:59.357653 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-55d1946f-1126-4978-8e80-585a941e21fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] HTTP exception thrown: Instance e8cddea8-25f9-440b-86f2-dd9c49130770 could not be found. Jul 22 22:19:59.358626 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-55d1946f-1126-4978-8e80-585a941e21fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Returning 404 to user: Instance e8cddea8-25f9-440b-86f2-dd9c49130770 could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:19:59.360879 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-55d1946f-1126-4978-8e80-585a941e21fd tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770" status: 404 len: 111 microversion: 2.1 time: 0.038516 Jul 22 22:19:59.381146 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 454/931] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:19:59 2021] GET /compute/v2.1/servers/e8cddea8-25f9-440b-86f2-dd9c49130770 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 22:19:59.391356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0694bcf1-39be-4d7c-b8d3-0db399fd783c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] Calling method '.version_select at 0x7f7d135ad160>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:19:59.430868 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0694bcf1-39be-4d7c-b8d3-0db399fd783c tempest-TestMinimumBasicScenario-602370819 tempest-TestMinimumBasicScenario-602370819-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1949086562" status: 202 len: 0 microversion: 2.1 time: 0.046264 Jul 22 22:19:59.431607 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 455/932] 10.222.0.110 () {58 vars in 1277 bytes} [Thu Jul 22 22:19:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1949086562 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:19:59.718354 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ae6cdd3a-a7f7-475e-b1d6-711672d48250 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:59.729006 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ae6cdd3a-a7f7-475e-b1d6-711672d48250 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:59.730803 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ae6cdd3a-a7f7-475e-b1d6-711672d48250 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:19:59.732990 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ae6cdd3a-a7f7-475e-b1d6-711672d48250 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1727 microversion: 2.20 time: 0.688628 Jul 22 22:19:59.734125 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 478/933] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:19:59 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1727 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:00.206395 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-414ed4af-545b-4570-bf51-479c386eafe7 req-e0003d4e-013a-4148-9296-826345f723dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e7dd91-3f55-48c9-85aa-84c2450719f2", "name": "network-vif-deleted", "tag": "e63aa00d-561e-478c-ad51-2858e1d33423"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:00.208267 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:00.208267 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:20:00.222978 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-414ed4af-545b-4570-bf51-479c386eafe7 req-e0003d4e-013a-4148-9296-826345f723dc service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:00.223523 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-414ed4af-545b-4570-bf51-479c386eafe7 req-e0003d4e-013a-4148-9296-826345f723dc service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:00.243935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-414ed4af-545b-4570-bf51-479c386eafe7 req-e0003d4e-013a-4148-9296-826345f723dc service nova] Creating event network-vif-deleted:e63aa00d-561e-478c-ad51-2858e1d33423 for instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 on hv-cinder-80186 Jul 22 22:20:00.253331 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-414ed4af-545b-4570-bf51-479c386eafe7 req-e0003d4e-013a-4148-9296-826345f723dc service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056414 Jul 22 22:20:00.254208 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 456/934] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:20:00.752667 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:00.754921 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:00.768241 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:00.769478 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:00.770513 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:00.771376 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:00.823594 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:00.823963 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:00.832152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lazy-loading 'fault' on Instance uuid 61e7dd91-3f55-48c9-85aa-84c2450719f2 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:20:00.888893 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:00.899909 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:00.901434 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:00.902596 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4bf9f9fa-a0ba-4ea7-8e6f-89a1491490cd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 200 len: 1376 microversion: 2.20 time: 0.155389 Jul 22 22:20:00.903153 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 479/935] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:00 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:01.921166 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9088d01f-d359-4e96-b7d4-d155cbdee7af tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:01.921930 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9088d01f-d359-4e96-b7d4-d155cbdee7af tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:01.929992 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9088d01f-d359-4e96-b7d4-d155cbdee7af tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:01.930447 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9088d01f-d359-4e96-b7d4-d155cbdee7af tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:01.931221 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9088d01f-d359-4e96-b7d4-d155cbdee7af tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:01.931657 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9088d01f-d359-4e96-b7d4-d155cbdee7af tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:01.954534 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-9088d01f-d359-4e96-b7d4-d155cbdee7af tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] HTTP exception thrown: Instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 could not be found. Jul 22 22:20:01.959889 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9088d01f-d359-4e96-b7d4-d155cbdee7af tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Returning 404 to user: Instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:20:01.960796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9088d01f-d359-4e96-b7d4-d155cbdee7af tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 404 len: 111 microversion: 2.20 time: 0.043814 Jul 22 22:20:01.962082 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 457/936] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:01 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 22 22:20:01.971111 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ff3914d3-8f52-4b90-963c-44dc8cd45c18 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '.version_select at 0x7f7d13706dc0>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:01.974837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ff3914d3-8f52-4b90-963c-44dc8cd45c18 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [24421536-5cc3-4915-8e93-ebb1ae5528b5] AMQP server on 10.222.0.110:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 22 22:20:02.993710 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO oslo.messaging._drivers.impl_rabbit [None req-ff3914d3-8f52-4b90-963c-44dc8cd45c18 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [24421536-5cc3-4915-8e93-ebb1ae5528b5] Reconnected to AMQP server on 10.222.0.110:5672 via [amqp] client with port 34680. Jul 22 22:20:03.020101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ff3914d3-8f52-4b90-963c-44dc8cd45c18 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099399197" status: 204 len: 0 microversion: 2.20 time: 1.053342 Jul 22 22:20:03.024261 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 480/937] 10.222.0.110 () {60 vars in 1267 bytes} [Thu Jul 22 22:20:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099399197 => generated 0 bytes in 1055 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 22 22:20:04.281277 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c80ca0c4-9302-4acc-8c78-50e45364793d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'create', calling method: .version_select at 0x7f7d135add30>, body: {"keypair": {"name": "tempest-keypair-955646166"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:04.314860 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-c80ca0c4-9302-4acc-8c78-50e45364793d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:20:04.319466 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-c80ca0c4-9302-4acc-8c78-50e45364793d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for user b12a8e4c8635473d9973af215bcbcc46 and project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:20:04.575330 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-c80ca0c4-9302-4acc-8c78-50e45364793d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:20:04.582173 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-c80ca0c4-9302-4acc-8c78-50e45364793d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for user b12a8e4c8635473d9973af215bcbcc46 and project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:20:04.601676 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c80ca0c4-9302-4acc-8c78-50e45364793d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.324837 Jul 22 22:20:04.602891 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 458/938] 10.222.0.110 () {62 vars in 1204 bytes} [Thu Jul 22 22:20:04 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 327 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 22 22:20:06.402653 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-400940189", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6df68dab-9491-409a-9b1c-2c69807e5f2f"}], "security_groups": [{"name": "tempest-securitygroup--1302897088"}], "key_name": "tempest-keypair-955646166", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:06.535473 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.network.neutron [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] validate_networks() for [('6df68dab-9491-409a-9b1c-2c69807e5f2f', None, None, None)] {{(pid=107499) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:20:07.330876 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Flavor limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:20:07.331833 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Image limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:20:07.332365 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Flavor pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:20:07.332782 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Image pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:20:07.333197 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:20:07.343331 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:07.344032 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:07.345044 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:07.346504 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:07.373481 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:20:07.379274 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Getting quotas for user b12a8e4c8635473d9973af215bcbcc46 and project 9c7420429ec848f6a4c1ad81eebaf705. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:20:07.399348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Going to run 1 instances... {{(pid=107499) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:20:07.405174 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107499) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:20:07.457274 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-68e47836-2b23-48c0-a45d-98131f008933 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.20 time: 1.059072 Jul 22 22:20:07.466493 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 481/939] 10.222.0.110 () {62 vars in 1193 bytes} [Thu Jul 22 22:20:06 2021] POST /compute/v2.1/servers => generated 404 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 22 22:20:07.468808 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e82cf331-bc9b-40f5-a0f2-6cb01d924d1e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:07.469956 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e82cf331-bc9b-40f5-a0f2-6cb01d924d1e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:07.539604 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e82cf331-bc9b-40f5-a0f2-6cb01d924d1e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:07.546968 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e82cf331-bc9b-40f5-a0f2-6cb01d924d1e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:07.549465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e82cf331-bc9b-40f5-a0f2-6cb01d924d1e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:07.554171 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e82cf331-bc9b-40f5-a0f2-6cb01d924d1e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1284 microversion: 2.20 time: 0.089587 Jul 22 22:20:07.555050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 459/940] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:07 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:20:08.573058 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-262e9e77-b198-4fb1-a331-8a215e52bf06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:08.573670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-262e9e77-b198-4fb1-a331-8a215e52bf06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:08.632532 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-262e9e77-b198-4fb1-a331-8a215e52bf06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:08.645467 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-262e9e77-b198-4fb1-a331-8a215e52bf06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:08.647516 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-262e9e77-b198-4fb1-a331-8a215e52bf06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:08.648832 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-262e9e77-b198-4fb1-a331-8a215e52bf06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1284 microversion: 2.20 time: 0.079499 Jul 22 22:20:08.649394 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 482/941] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:08 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1284 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:09.667313 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a3d4c341-c542-43ed-a242-4a5c5239550e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:09.668297 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a3d4c341-c542-43ed-a242-4a5c5239550e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:09.750622 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a3d4c341-c542-43ed-a242-4a5c5239550e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:09.758517 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a3d4c341-c542-43ed-a242-4a5c5239550e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:09.760100 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a3d4c341-c542-43ed-a242-4a5c5239550e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:09.761181 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a3d4c341-c542-43ed-a242-4a5c5239550e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1284 microversion: 2.20 time: 0.097858 Jul 22 22:20:09.761787 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 460/942] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:09 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:10.780531 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7ab2f7ba-52a5-4815-8661-48552f8a8542 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:10.781144 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7ab2f7ba-52a5-4815-8661-48552f8a8542 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:10.846179 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7ab2f7ba-52a5-4815-8661-48552f8a8542 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:10.861249 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7ab2f7ba-52a5-4815-8661-48552f8a8542 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:10.861249 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7ab2f7ba-52a5-4815-8661-48552f8a8542 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:10.861249 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7ab2f7ba-52a5-4815-8661-48552f8a8542 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1284 microversion: 2.20 time: 0.083415 Jul 22 22:20:10.861624 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 483/943] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:10 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:11.878708 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-889b2483-f65b-4446-bfd4-54aead720ca1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:11.879445 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-889b2483-f65b-4446-bfd4-54aead720ca1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:11.885574 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-889b2483-f65b-4446-bfd4-54aead720ca1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:11.886022 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-889b2483-f65b-4446-bfd4-54aead720ca1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:11.886832 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-889b2483-f65b-4446-bfd4-54aead720ca1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:11.887265 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-889b2483-f65b-4446-bfd4-54aead720ca1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:11.959526 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-889b2483-f65b-4446-bfd4-54aead720ca1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:11.970429 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-889b2483-f65b-4446-bfd4-54aead720ca1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:11.972396 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-889b2483-f65b-4446-bfd4-54aead720ca1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:11.973713 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-889b2483-f65b-4446-bfd4-54aead720ca1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1288 microversion: 2.20 time: 0.099072 Jul 22 22:20:11.984190 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 461/944] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:11 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:12.991767 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7d8dd900-d616-4d6e-b469-0908bbb74634 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:12.993157 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7d8dd900-d616-4d6e-b469-0908bbb74634 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:12.999927 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d8dd900-d616-4d6e-b469-0908bbb74634 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:13.000366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d8dd900-d616-4d6e-b469-0908bbb74634 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:13.001844 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d8dd900-d616-4d6e-b469-0908bbb74634 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:13.002547 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d8dd900-d616-4d6e-b469-0908bbb74634 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:13.081890 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7d8dd900-d616-4d6e-b469-0908bbb74634 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:13.090644 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7d8dd900-d616-4d6e-b469-0908bbb74634 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:13.092241 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7d8dd900-d616-4d6e-b469-0908bbb74634 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:13.093348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7d8dd900-d616-4d6e-b469-0908bbb74634 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1354 microversion: 2.20 time: 0.105834 Jul 22 22:20:13.093874 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 484/945] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:12 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:14.110963 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-18800b88-79a2-4e6c-9abb-c71d7a16a3c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:14.112135 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-18800b88-79a2-4e6c-9abb-c71d7a16a3c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:14.118668 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18800b88-79a2-4e6c-9abb-c71d7a16a3c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:14.119247 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18800b88-79a2-4e6c-9abb-c71d7a16a3c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:14.120138 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18800b88-79a2-4e6c-9abb-c71d7a16a3c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:14.120699 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18800b88-79a2-4e6c-9abb-c71d7a16a3c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:14.269313 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-18800b88-79a2-4e6c-9abb-c71d7a16a3c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:14.277802 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-18800b88-79a2-4e6c-9abb-c71d7a16a3c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:14.279602 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-18800b88-79a2-4e6c-9abb-c71d7a16a3c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:14.280898 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-18800b88-79a2-4e6c-9abb-c71d7a16a3c7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1410 microversion: 2.20 time: 0.173816 Jul 22 22:20:14.281603 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 462/946] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:14 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1410 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:14.506563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-63662591-4d1e-4118-a85b-0e624e109b53 req-83b74a26-33a6-4347-9550-f7674f1353ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a594cb-1699-4423-9bf3-f141ab59ad1d", "tag": "faef284b-3bc0-45b4-9175-e5021628b786"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:14.509180 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:14.509180 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:20:14.526123 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-63662591-4d1e-4118-a85b-0e624e109b53 req-83b74a26-33a6-4347-9550-f7674f1353ef service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:14.526568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-63662591-4d1e-4118-a85b-0e624e109b53 req-83b74a26-33a6-4347-9550-f7674f1353ef service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:14.545605 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-63662591-4d1e-4118-a85b-0e624e109b53 req-83b74a26-33a6-4347-9550-f7674f1353ef service nova] Creating event network-changed:faef284b-3bc0-45b4-9175-e5021628b786 for instance 39a594cb-1699-4423-9bf3-f141ab59ad1d on hv-cinder-80186 Jul 22 22:20:14.551694 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-63662591-4d1e-4118-a85b-0e624e109b53 req-83b74a26-33a6-4347-9550-f7674f1353ef service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048749 Jul 22 22:20:14.552645 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 485/947] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:20:15.311986 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5518ff46-c270-46a7-a352-18a8b6ad5650 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:15.312676 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5518ff46-c270-46a7-a352-18a8b6ad5650 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:15.320082 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5518ff46-c270-46a7-a352-18a8b6ad5650 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:15.320574 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5518ff46-c270-46a7-a352-18a8b6ad5650 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:15.321365 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5518ff46-c270-46a7-a352-18a8b6ad5650 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:15.321976 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5518ff46-c270-46a7-a352-18a8b6ad5650 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:15.494273 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5518ff46-c270-46a7-a352-18a8b6ad5650 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:15.502822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5518ff46-c270-46a7-a352-18a8b6ad5650 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:15.504532 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5518ff46-c270-46a7-a352-18a8b6ad5650 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:15.505640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5518ff46-c270-46a7-a352-18a8b6ad5650 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1410 microversion: 2.20 time: 0.197808 Jul 22 22:20:15.506191 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 463/948] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:15 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1410 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:16.523290 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5c807b61-f769-4ed6-9db3-589160cbe3a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:16.524075 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5c807b61-f769-4ed6-9db3-589160cbe3a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:16.530448 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5c807b61-f769-4ed6-9db3-589160cbe3a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:16.531013 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5c807b61-f769-4ed6-9db3-589160cbe3a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:16.531848 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5c807b61-f769-4ed6-9db3-589160cbe3a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:16.532437 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5c807b61-f769-4ed6-9db3-589160cbe3a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:16.675377 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5c807b61-f769-4ed6-9db3-589160cbe3a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:16.683455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5c807b61-f769-4ed6-9db3-589160cbe3a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:16.684982 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5c807b61-f769-4ed6-9db3-589160cbe3a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:16.686066 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5c807b61-f769-4ed6-9db3-589160cbe3a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1410 microversion: 2.20 time: 0.166863 Jul 22 22:20:16.686623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 486/949] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:16 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:17.703834 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6db4720e-8ef9-4534-b6e0-993db92053c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:17.705331 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6db4720e-8ef9-4534-b6e0-993db92053c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:17.711301 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6db4720e-8ef9-4534-b6e0-993db92053c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:17.712016 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6db4720e-8ef9-4534-b6e0-993db92053c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:17.712821 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6db4720e-8ef9-4534-b6e0-993db92053c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:17.713258 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6db4720e-8ef9-4534-b6e0-993db92053c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:17.858591 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6db4720e-8ef9-4534-b6e0-993db92053c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:17.869464 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6db4720e-8ef9-4534-b6e0-993db92053c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:17.871051 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6db4720e-8ef9-4534-b6e0-993db92053c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:17.872146 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6db4720e-8ef9-4534-b6e0-993db92053c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1410 microversion: 2.20 time: 0.172113 Jul 22 22:20:17.872986 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 464/950] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:17 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1410 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:18.894110 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-259bc865-c4e1-4cf7-a967-3f99b5a7932b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:18.894821 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-259bc865-c4e1-4cf7-a967-3f99b5a7932b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:18.900940 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-259bc865-c4e1-4cf7-a967-3f99b5a7932b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:18.901455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-259bc865-c4e1-4cf7-a967-3f99b5a7932b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:18.902337 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-259bc865-c4e1-4cf7-a967-3f99b5a7932b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:18.902843 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-259bc865-c4e1-4cf7-a967-3f99b5a7932b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:19.047523 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-259bc865-c4e1-4cf7-a967-3f99b5a7932b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:19.057002 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-259bc865-c4e1-4cf7-a967-3f99b5a7932b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:19.058723 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-259bc865-c4e1-4cf7-a967-3f99b5a7932b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:19.060067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-259bc865-c4e1-4cf7-a967-3f99b5a7932b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1410 microversion: 2.20 time: 0.172339 Jul 22 22:20:19.060651 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 487/951] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:18 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1410 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:20.076101 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: ERROR oslo.messaging._drivers.impl_rabbit [-] [16b32c1b-22e6-46c2-9d54-d640c25a9a14] AMQP server on 10.222.0.110:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 22 22:20:20.079397 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8d6e7251-a2fd-4cc1-a6b5-1ee62008733a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:20.081206 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8d6e7251-a2fd-4cc1-a6b5-1ee62008733a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:20.087397 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8d6e7251-a2fd-4cc1-a6b5-1ee62008733a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:20.087844 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8d6e7251-a2fd-4cc1-a6b5-1ee62008733a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:20.088654 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8d6e7251-a2fd-4cc1-a6b5-1ee62008733a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:20.089089 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8d6e7251-a2fd-4cc1-a6b5-1ee62008733a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:20.237813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8d6e7251-a2fd-4cc1-a6b5-1ee62008733a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:20.245897 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8d6e7251-a2fd-4cc1-a6b5-1ee62008733a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:20.247490 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8d6e7251-a2fd-4cc1-a6b5-1ee62008733a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:20.248684 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8d6e7251-a2fd-4cc1-a6b5-1ee62008733a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1410 microversion: 2.20 time: 0.173990 Jul 22 22:20:20.249323 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 465/952] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:20 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1410 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:21.171075 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-c6f997e2-515b-45f3-9793-c553de8fb945 req-8b377cf3-8ca5-465c-b234-4ba7f874bc76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a594cb-1699-4423-9bf3-f141ab59ad1d", "name": "network-vif-plugged", "status": "completed", "tag": "faef284b-3bc0-45b4-9175-e5021628b786"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:21.172699 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:21.172699 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:20:21.180779 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-c6f997e2-515b-45f3-9793-c553de8fb945 req-8b377cf3-8ca5-465c-b234-4ba7f874bc76 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:21.181222 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-c6f997e2-515b-45f3-9793-c553de8fb945 req-8b377cf3-8ca5-465c-b234-4ba7f874bc76 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:21.192539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-c6f997e2-515b-45f3-9793-c553de8fb945 req-8b377cf3-8ca5-465c-b234-4ba7f874bc76 service nova] Creating event network-vif-plugged:faef284b-3bc0-45b4-9175-e5021628b786 for instance 39a594cb-1699-4423-9bf3-f141ab59ad1d on hv-cinder-80186 Jul 22 22:20:21.197196 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-c6f997e2-515b-45f3-9793-c553de8fb945 req-8b377cf3-8ca5-465c-b234-4ba7f874bc76 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160241 Jul 22 22:20:21.197797 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 488/953] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:20:21.266832 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ec73c814-65bc-4e8f-989e-c9e0f2b235e1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:21.268322 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ec73c814-65bc-4e8f-989e-c9e0f2b235e1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:21.285325 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ec73c814-65bc-4e8f-989e-c9e0f2b235e1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:21.285774 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ec73c814-65bc-4e8f-989e-c9e0f2b235e1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:21.286561 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ec73c814-65bc-4e8f-989e-c9e0f2b235e1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:21.286993 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ec73c814-65bc-4e8f-989e-c9e0f2b235e1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:21.292894 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] [16b32c1b-22e6-46c2-9d54-d640c25a9a14] Reconnected to AMQP server on 10.222.0.110:5672 via [amqp] client with port 35134. Jul 22 22:20:21.432367 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ec73c814-65bc-4e8f-989e-c9e0f2b235e1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:21.441082 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ec73c814-65bc-4e8f-989e-c9e0f2b235e1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:21.442663 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ec73c814-65bc-4e8f-989e-c9e0f2b235e1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:21.443705 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ec73c814-65bc-4e8f-989e-c9e0f2b235e1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1410 microversion: 2.20 time: 0.180679 Jul 22 22:20:21.448333 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 466/954] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:21 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1410 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:22.466010 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-603f22cf-ad81-4b0d-b777-648da362e396 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:22.467343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-603f22cf-ad81-4b0d-b777-648da362e396 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:22.476145 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-603f22cf-ad81-4b0d-b777-648da362e396 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:22.476855 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-603f22cf-ad81-4b0d-b777-648da362e396 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:22.477803 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-603f22cf-ad81-4b0d-b777-648da362e396 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:22.478339 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-603f22cf-ad81-4b0d-b777-648da362e396 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:22.648370 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-603f22cf-ad81-4b0d-b777-648da362e396 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:22.656337 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-603f22cf-ad81-4b0d-b777-648da362e396 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:22.657889 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-603f22cf-ad81-4b0d-b777-648da362e396 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:22.658969 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-603f22cf-ad81-4b0d-b777-648da362e396 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1410 microversion: 2.20 time: 0.200055 Jul 22 22:20:22.659521 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 489/955] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:22 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1410 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:23.677614 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-30811175-b392-4446-81d9-99bddb719fad tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:23.678236 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-30811175-b392-4446-81d9-99bddb719fad tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:23.684202 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-30811175-b392-4446-81d9-99bddb719fad tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:23.684681 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-30811175-b392-4446-81d9-99bddb719fad tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:23.685465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-30811175-b392-4446-81d9-99bddb719fad tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:23.685889 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-30811175-b392-4446-81d9-99bddb719fad tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:23.837532 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-30811175-b392-4446-81d9-99bddb719fad tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:23.846676 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-30811175-b392-4446-81d9-99bddb719fad tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:23.848820 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-30811175-b392-4446-81d9-99bddb719fad tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:23.850161 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-30811175-b392-4446-81d9-99bddb719fad tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1601 microversion: 2.20 time: 0.176778 Jul 22 22:20:23.850649 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 467/956] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:20:23 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1601 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:23.869349 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-61cbbc40-9b3a-4f37-a2ff-2988e5ce9741 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:23.870238 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-61cbbc40-9b3a-4f37-a2ff-2988e5ce9741 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:23.876096 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-61cbbc40-9b3a-4f37-a2ff-2988e5ce9741 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:23.880525 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-61cbbc40-9b3a-4f37-a2ff-2988e5ce9741 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:23.881356 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-61cbbc40-9b3a-4f37-a2ff-2988e5ce9741 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:23.881794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-61cbbc40-9b3a-4f37-a2ff-2988e5ce9741 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:23.999497 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-61cbbc40-9b3a-4f37-a2ff-2988e5ce9741 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.133834 Jul 22 22:20:24.000224 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 490/957] 10.222.0.110 () {60 vars in 1321 bytes} [Thu Jul 22 22:20:23 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:20:24.105825 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-38cb0cfe-1e81-466a-adae-5f64c1d0cf0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:24.106319 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-38cb0cfe-1e81-466a-adae-5f64c1d0cf0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:24.113135 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-38cb0cfe-1e81-466a-adae-5f64c1d0cf0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:24.113574 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-38cb0cfe-1e81-466a-adae-5f64c1d0cf0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:24.114377 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-38cb0cfe-1e81-466a-adae-5f64c1d0cf0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:24.114809 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-38cb0cfe-1e81-466a-adae-5f64c1d0cf0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:24.141210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-38cb0cfe-1e81-466a-adae-5f64c1d0cf0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:20:24.228793 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-38cb0cfe-1e81-466a-adae-5f64c1d0cf0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "DELETE /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 204 len: 0 microversion: 2.1 time: 0.126199 Jul 22 22:20:24.229668 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 468/958] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:20:24 2021] DELETE /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:20:24.238740 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c8e192e3-0b0c-4ee2-a0d0-7e8fb748649d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:24.239628 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c8e192e3-0b0c-4ee2-a0d0-7e8fb748649d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:24.250353 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c8e192e3-0b0c-4ee2-a0d0-7e8fb748649d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:24.250889 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c8e192e3-0b0c-4ee2-a0d0-7e8fb748649d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:24.251710 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c8e192e3-0b0c-4ee2-a0d0-7e8fb748649d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:24.252456 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c8e192e3-0b0c-4ee2-a0d0-7e8fb748649d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:24.793127 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c8e192e3-0b0c-4ee2-a0d0-7e8fb748649d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:24.801049 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c8e192e3-0b0c-4ee2-a0d0-7e8fb748649d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1680 microversion: 2.1 time: 0.567064 Jul 22 22:20:24.801628 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 491/959] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:24 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1680 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:25.568807 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5031f3ed-9cb4-49e3-84e6-ac4a6da39aeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:25.575723 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5031f3ed-9cb4-49e3-84e6-ac4a6da39aeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:25.577080 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-519af241-b36b-4ff5-8c27-618b10cba8be req-8a5259ea-6133-4bf3-9a4e-e7ee0415a435 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39a594cb-1699-4423-9bf3-f141ab59ad1d", "tag": "faef284b-3bc0-45b4-9175-e5021628b786"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:25.580368 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:25.580368 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:20:25.586906 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5031f3ed-9cb4-49e3-84e6-ac4a6da39aeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:25.587366 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5031f3ed-9cb4-49e3-84e6-ac4a6da39aeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:25.588158 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5031f3ed-9cb4-49e3-84e6-ac4a6da39aeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:25.588637 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5031f3ed-9cb4-49e3-84e6-ac4a6da39aeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:25.602065 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-519af241-b36b-4ff5-8c27-618b10cba8be req-8a5259ea-6133-4bf3-9a4e-e7ee0415a435 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:25.602976 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-519af241-b36b-4ff5-8c27-618b10cba8be req-8a5259ea-6133-4bf3-9a4e-e7ee0415a435 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:25.623785 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-519af241-b36b-4ff5-8c27-618b10cba8be req-8a5259ea-6133-4bf3-9a4e-e7ee0415a435 service nova] Creating event network-changed:faef284b-3bc0-45b4-9175-e5021628b786 for instance 39a594cb-1699-4423-9bf3-f141ab59ad1d on hv-cinder-80186 Jul 22 22:20:25.633624 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-519af241-b36b-4ff5-8c27-618b10cba8be req-8a5259ea-6133-4bf3-9a4e-e7ee0415a435 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062383 Jul 22 22:20:25.635721 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 492/960] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:20:25.818036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5031f3ed-9cb4-49e3-84e6-ac4a6da39aeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.257048 Jul 22 22:20:25.818980 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 469/961] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:25 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:25.820053 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7d3d6ada-4d6a-4ce1-9a89-aaa257676666 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:25.820888 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7d3d6ada-4d6a-4ce1-9a89-aaa257676666 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:25.836537 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d3d6ada-4d6a-4ce1-9a89-aaa257676666 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:25.837216 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d3d6ada-4d6a-4ce1-9a89-aaa257676666 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:25.838133 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d3d6ada-4d6a-4ce1-9a89-aaa257676666 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:25.838771 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d3d6ada-4d6a-4ce1-9a89-aaa257676666 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:26.099704 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7d3d6ada-4d6a-4ce1-9a89-aaa257676666 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:26.108269 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7d3d6ada-4d6a-4ce1-9a89-aaa257676666 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1680 microversion: 2.1 time: 0.293374 Jul 22 22:20:26.109060 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 493/962] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:25 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1680 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:26.835257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2de36163-4e47-4639-b162-e9ce46f1f147 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:26.837248 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2de36163-4e47-4639-b162-e9ce46f1f147 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:26.845578 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2de36163-4e47-4639-b162-e9ce46f1f147 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:26.846568 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2de36163-4e47-4639-b162-e9ce46f1f147 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:26.847784 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2de36163-4e47-4639-b162-e9ce46f1f147 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:26.848597 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2de36163-4e47-4639-b162-e9ce46f1f147 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:26.963864 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2de36163-4e47-4639-b162-e9ce46f1f147 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.138139 Jul 22 22:20:26.964967 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 470/963] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:26 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:27.131321 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-143d437e-5817-45c1-842f-a77b56713226 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:27.132546 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-143d437e-5817-45c1-842f-a77b56713226 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:27.140909 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-143d437e-5817-45c1-842f-a77b56713226 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:27.142166 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-143d437e-5817-45c1-842f-a77b56713226 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:27.143434 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-143d437e-5817-45c1-842f-a77b56713226 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:27.144604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-143d437e-5817-45c1-842f-a77b56713226 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:27.227831 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-143d437e-5817-45c1-842f-a77b56713226 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:27.236180 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-143d437e-5817-45c1-842f-a77b56713226 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 200 len: 1612 microversion: 2.1 time: 0.113465 Jul 22 22:20:27.238761 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 494/964] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:27 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 1612 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:27.360650 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-aac3d8ec-cef4-409b-8e51-08b0a3e2098e req-dcfe87ad-9c7e-443d-ba05-e70d33bcbcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c", "name": "network-vif-deleted", "tag": "ca634450-7b4f-4ad9-a31e-a585086203cf"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:27.362945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:27.362945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:20:27.376027 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-aac3d8ec-cef4-409b-8e51-08b0a3e2098e req-dcfe87ad-9c7e-443d-ba05-e70d33bcbcb1 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:27.376508 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-aac3d8ec-cef4-409b-8e51-08b0a3e2098e req-dcfe87ad-9c7e-443d-ba05-e70d33bcbcb1 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:27.391212 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-aac3d8ec-cef4-409b-8e51-08b0a3e2098e req-dcfe87ad-9c7e-443d-ba05-e70d33bcbcb1 service nova] Creating event network-vif-deleted:ca634450-7b4f-4ad9-a31e-a585086203cf for instance 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c on hv-cinder-80186 Jul 22 22:20:27.397419 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-aac3d8ec-cef4-409b-8e51-08b0a3e2098e req-dcfe87ad-9c7e-443d-ba05-e70d33bcbcb1 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040952 Jul 22 22:20:27.398648 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 471/965] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:20:27.976769 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5cfd6536-bac7-4529-9dfe-4ba57de5e404 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:27.978079 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5cfd6536-bac7-4529-9dfe-4ba57de5e404 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:27.985046 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5cfd6536-bac7-4529-9dfe-4ba57de5e404 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:27.985802 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5cfd6536-bac7-4529-9dfe-4ba57de5e404 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:27.987632 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5cfd6536-bac7-4529-9dfe-4ba57de5e404 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:27.988447 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5cfd6536-bac7-4529-9dfe-4ba57de5e404 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:28.102104 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5cfd6536-bac7-4529-9dfe-4ba57de5e404 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.128920 Jul 22 22:20:28.105782 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 495/966] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:27 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:28.257081 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-49865049-c913-4463-af54-86ccf58bf0df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:28.258366 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-49865049-c913-4463-af54-86ccf58bf0df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:28.265041 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49865049-c913-4463-af54-86ccf58bf0df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:28.265503 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49865049-c913-4463-af54-86ccf58bf0df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:28.266288 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49865049-c913-4463-af54-86ccf58bf0df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:28.266728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-49865049-c913-4463-af54-86ccf58bf0df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:28.282002 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-49865049-c913-4463-af54-86ccf58bf0df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] HTTP exception thrown: Instance 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c could not be found. Jul 22 22:20:28.282611 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-49865049-c913-4463-af54-86ccf58bf0df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Returning 404 to user: Instance 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:20:28.283725 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-49865049-c913-4463-af54-86ccf58bf0df tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 404 len: 111 microversion: 2.1 time: 0.031236 Jul 22 22:20:28.284569 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 472/967] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:28 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:20:28.293346 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ab617645-4b54-4b36-81d4-6eb336dbadb4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '.version_select at 0x7f7d13706d30>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:28.318036 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ab617645-4b54-4b36-81d4-6eb336dbadb4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853979202" status: 202 len: 0 microversion: 2.1 time: 0.028679 Jul 22 22:20:28.319073 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 496/968] 10.222.0.110 () {58 vars in 1226 bytes} [Thu Jul 22 22:20:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853979202 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:20:29.028094 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6be522fc-d2ae-4307-be86-f17faf6693c8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'create', calling method: .version_select at 0x7f7d13579d30>, body: {"keypair": {"name": "tempest-keypair-231374187"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:29.045711 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6be522fc-d2ae-4307-be86-f17faf6693c8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for project 93164c7b18524c7f9483aa0383349cb9. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:20:29.049809 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6be522fc-d2ae-4307-be86-f17faf6693c8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for user b1d770b6425649559463a5d37c3f3a3f and project 93164c7b18524c7f9483aa0383349cb9. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:20:29.113060 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ac319a23-5551-4fac-b569-88091cd17e1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:29.114093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ac319a23-5551-4fac-b569-88091cd17e1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:29.120906 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ac319a23-5551-4fac-b569-88091cd17e1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:29.121491 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ac319a23-5551-4fac-b569-88091cd17e1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:29.122604 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ac319a23-5551-4fac-b569-88091cd17e1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:29.123143 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ac319a23-5551-4fac-b569-88091cd17e1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:29.238594 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ac319a23-5551-4fac-b569-88091cd17e1a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.129407 Jul 22 22:20:29.239237 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 497/969] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:29 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:29.321718 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6be522fc-d2ae-4307-be86-f17faf6693c8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for project 93164c7b18524c7f9483aa0383349cb9. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:20:29.325380 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-6be522fc-d2ae-4307-be86-f17faf6693c8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for user b1d770b6425649559463a5d37c3f3a3f and project 93164c7b18524c7f9483aa0383349cb9. Resources: {'key_pairs'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:20:29.339005 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6be522fc-d2ae-4307-be86-f17faf6693c8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.314718 Jul 22 22:20:29.339590 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 473/970] 10.222.0.110 () {60 vars in 1163 bytes} [Thu Jul 22 22:20:29 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:30.249024 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d9b5006e-014a-4030-bd21-0a79e459108b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:30.250046 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d9b5006e-014a-4030-bd21-0a79e459108b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:30.257557 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d9b5006e-014a-4030-bd21-0a79e459108b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:30.258101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d9b5006e-014a-4030-bd21-0a79e459108b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:30.258883 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d9b5006e-014a-4030-bd21-0a79e459108b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:30.259312 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d9b5006e-014a-4030-bd21-0a79e459108b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:30.371913 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d9b5006e-014a-4030-bd21-0a79e459108b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.126745 Jul 22 22:20:30.372842 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 498/971] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:30 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:30.693948 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1565084360", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5dcfbf64-3926-45d8-838a-8c062184c27a"}], "security_groups": [{"name": "tempest-securitygroup--1616485855"}], "key_name": "tempest-keypair-231374187", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:30.796614 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.network.neutron [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] validate_networks() for [('5dcfbf64-3926-45d8-838a-8c062184c27a', None, None, None)] {{(pid=107498) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:20:31.290884 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Flavor limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:20:31.291310 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Image limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:20:31.291818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Flavor pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:20:31.292340 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Image pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:20:31.292677 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:20:31.303564 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:31.304060 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:31.304910 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:31.305349 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:31.323367 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for project 93164c7b18524c7f9483aa0383349cb9. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:20:31.327692 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Getting quotas for user b1d770b6425649559463a5d37c3f3a3f and project 93164c7b18524c7f9483aa0383349cb9. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:20:31.340297 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Going to run 1 instances... {{(pid=107498) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:20:31.342661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:20:31.384857 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5366ae91-5347-4440-827f-0c3a4325e9c5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:31.387455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5366ae91-5347-4440-827f-0c3a4325e9c5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:31.394898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5366ae91-5347-4440-827f-0c3a4325e9c5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:31.395112 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c1fbffeb-3bda-47be-81aa-83b30cda6bc3 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.706077 Jul 22 22:20:31.395339 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5366ae91-5347-4440-827f-0c3a4325e9c5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:31.396155 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 474/972] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:20:30 2021] POST /compute/v2.1/servers => generated 404 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:20:31.396833 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5366ae91-5347-4440-827f-0c3a4325e9c5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:31.397298 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5366ae91-5347-4440-827f-0c3a4325e9c5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:31.407235 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7324f777-1d01-493e-b62f-47f3796a93da tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:31.407860 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7324f777-1d01-493e-b62f-47f3796a93da tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:31.472791 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7324f777-1d01-493e-b62f-47f3796a93da tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:31.480496 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7324f777-1d01-493e-b62f-47f3796a93da tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1241 microversion: 2.1 time: 0.078261 Jul 22 22:20:31.484452 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 475/973] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:31 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:31.504508 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5366ae91-5347-4440-827f-0c3a4325e9c5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.123869 Jul 22 22:20:31.505478 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 499/974] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:31 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:32.109331 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-78b276ea-b790-4374-ae0e-0d12b1709f6c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:32.109847 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-78b276ea-b790-4374-ae0e-0d12b1709f6c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:32.119913 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-78b276ea-b790-4374-ae0e-0d12b1709f6c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:32.120455 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-78b276ea-b790-4374-ae0e-0d12b1709f6c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:32.121401 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-78b276ea-b790-4374-ae0e-0d12b1709f6c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:32.122083 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-78b276ea-b790-4374-ae0e-0d12b1709f6c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:32.149547 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-78b276ea-b790-4374-ae0e-0d12b1709f6c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:20:32.228223 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-78b276ea-b790-4374-ae0e-0d12b1709f6c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "DELETE /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 204 len: 0 microversion: 2.1 time: 0.122511 Jul 22 22:20:32.228833 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 476/975] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:20:32 2021] DELETE /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 22 22:20:32.238742 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6db01d5b-8020-459b-9bc2-a02bd3006180 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:32.239528 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6db01d5b-8020-459b-9bc2-a02bd3006180 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:32.245843 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6db01d5b-8020-459b-9bc2-a02bd3006180 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:32.246287 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6db01d5b-8020-459b-9bc2-a02bd3006180 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:32.247053 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6db01d5b-8020-459b-9bc2-a02bd3006180 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:32.247500 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6db01d5b-8020-459b-9bc2-a02bd3006180 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:32.392508 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6db01d5b-8020-459b-9bc2-a02bd3006180 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:32.399815 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6db01d5b-8020-459b-9bc2-a02bd3006180 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1582 microversion: 2.1 time: 0.166285 Jul 22 22:20:32.400402 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 500/976] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:32 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1582 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:32.497857 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ad567e3e-cf5f-4c48-8d1b-a832ce1f5d0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:32.498850 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ad567e3e-cf5f-4c48-8d1b-a832ce1f5d0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:32.507246 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ad567e3e-cf5f-4c48-8d1b-a832ce1f5d0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:32.507697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ad567e3e-cf5f-4c48-8d1b-a832ce1f5d0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:32.510339 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ad567e3e-cf5f-4c48-8d1b-a832ce1f5d0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:32.510339 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ad567e3e-cf5f-4c48-8d1b-a832ce1f5d0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:32.526475 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a3cb937d-6521-42af-8b92-aa93cb3a8a2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:32.527639 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a3cb937d-6521-42af-8b92-aa93cb3a8a2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:32.535153 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a3cb937d-6521-42af-8b92-aa93cb3a8a2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:32.537103 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a3cb937d-6521-42af-8b92-aa93cb3a8a2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:32.537103 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a3cb937d-6521-42af-8b92-aa93cb3a8a2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:32.537301 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a3cb937d-6521-42af-8b92-aa93cb3a8a2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:32.601397 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ad567e3e-cf5f-4c48-8d1b-a832ce1f5d0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:32.610128 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ad567e3e-cf5f-4c48-8d1b-a832ce1f5d0b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1293 microversion: 2.1 time: 0.116163 Jul 22 22:20:32.610840 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 477/977] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:32 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1293 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:32.693085 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a3cb937d-6521-42af-8b92-aa93cb3a8a2e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.179772 Jul 22 22:20:32.697886 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 501/978] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:32 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:33.418290 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4c0717ec-3e13-484c-93cb-e7f559da1bcc tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:33.418991 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4c0717ec-3e13-484c-93cb-e7f559da1bcc tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:33.426956 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4c0717ec-3e13-484c-93cb-e7f559da1bcc tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:33.427473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4c0717ec-3e13-484c-93cb-e7f559da1bcc tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:33.428343 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4c0717ec-3e13-484c-93cb-e7f559da1bcc tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:33.428918 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4c0717ec-3e13-484c-93cb-e7f559da1bcc tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:33.629900 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-30952704-2afb-407e-8f11-0c0407f217c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:33.631352 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-30952704-2afb-407e-8f11-0c0407f217c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:33.638465 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-30952704-2afb-407e-8f11-0c0407f217c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:33.638842 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-30952704-2afb-407e-8f11-0c0407f217c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:33.639610 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-30952704-2afb-407e-8f11-0c0407f217c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:33.640034 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-30952704-2afb-407e-8f11-0c0407f217c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:33.680991 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4c0717ec-3e13-484c-93cb-e7f559da1bcc tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:33.693331 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4c0717ec-3e13-484c-93cb-e7f559da1bcc tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1582 microversion: 2.1 time: 0.279748 Jul 22 22:20:33.694143 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 478/979] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:33 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1582 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:33.715327 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2bfe884f-68c3-41a9-94ba-cd485f21936c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:33.719651 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2bfe884f-68c3-41a9-94ba-cd485f21936c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:33.727164 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bfe884f-68c3-41a9-94ba-cd485f21936c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:33.727915 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bfe884f-68c3-41a9-94ba-cd485f21936c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:33.729061 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bfe884f-68c3-41a9-94ba-cd485f21936c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:33.729960 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2bfe884f-68c3-41a9-94ba-cd485f21936c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:33.834022 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-30952704-2afb-407e-8f11-0c0407f217c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:33.841763 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-30952704-2afb-407e-8f11-0c0407f217c5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1367 microversion: 2.1 time: 0.216626 Jul 22 22:20:33.842328 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 502/980] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:33 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:33.875782 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2bfe884f-68c3-41a9-94ba-cd485f21936c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.168700 Jul 22 22:20:33.876694 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 479/981] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:33 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:34.506351 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-1aec614a-ba31-461a-95f6-ee3bc83026c9 req-9d67d0c0-55f5-40a4-81ee-f35d5bdcd554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8f4f51-e0f7-44c6-9502-719ce8f4e606", "tag": "245b2585-5883-4ee1-ac31-1b72b9c0513b"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:34.508736 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:34.508736 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:20:34.516243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-1aec614a-ba31-461a-95f6-ee3bc83026c9 req-9d67d0c0-55f5-40a4-81ee-f35d5bdcd554 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:34.517003 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-1aec614a-ba31-461a-95f6-ee3bc83026c9 req-9d67d0c0-55f5-40a4-81ee-f35d5bdcd554 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:34.529571 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-1aec614a-ba31-461a-95f6-ee3bc83026c9 req-9d67d0c0-55f5-40a4-81ee-f35d5bdcd554 service nova] Creating event network-changed:245b2585-5883-4ee1-ac31-1b72b9c0513b for instance ba8f4f51-e0f7-44c6-9502-719ce8f4e606 on hv-cinder-80186 Jul 22 22:20:34.534358 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-1aec614a-ba31-461a-95f6-ee3bc83026c9 req-9d67d0c0-55f5-40a4-81ee-f35d5bdcd554 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032606 Jul 22 22:20:34.534953 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 503/982] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:20:34.712593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-615e941d-cfec-45ee-85dd-76280430123f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:34.713281 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-615e941d-cfec-45ee-85dd-76280430123f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:34.719608 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-615e941d-cfec-45ee-85dd-76280430123f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:34.720049 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-615e941d-cfec-45ee-85dd-76280430123f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:34.720844 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-615e941d-cfec-45ee-85dd-76280430123f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:34.721470 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-615e941d-cfec-45ee-85dd-76280430123f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:34.861484 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-65dadb4b-d2a0-42cd-be11-a3d0bafd211b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:34.862510 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-65dadb4b-d2a0-42cd-be11-a3d0bafd211b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:34.869716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65dadb4b-d2a0-42cd-be11-a3d0bafd211b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:34.870568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65dadb4b-d2a0-42cd-be11-a3d0bafd211b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:34.871793 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65dadb4b-d2a0-42cd-be11-a3d0bafd211b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:34.872414 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-65dadb4b-d2a0-42cd-be11-a3d0bafd211b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:34.911812 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-615e941d-cfec-45ee-85dd-76280430123f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:34.919047 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-615e941d-cfec-45ee-85dd-76280430123f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1582 microversion: 2.1 time: 0.210619 Jul 22 22:20:34.919775 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 480/983] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:34 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1582 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:34.925716 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b3b7a2e4-97af-4149-bf36-2eb0e0bce0c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:34.928122 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b3b7a2e4-97af-4149-bf36-2eb0e0bce0c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:34.934480 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3b7a2e4-97af-4149-bf36-2eb0e0bce0c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:34.935018 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3b7a2e4-97af-4149-bf36-2eb0e0bce0c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:34.935967 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3b7a2e4-97af-4149-bf36-2eb0e0bce0c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:34.936744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3b7a2e4-97af-4149-bf36-2eb0e0bce0c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:35.072226 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b3b7a2e4-97af-4149-bf36-2eb0e0bce0c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.151114 Jul 22 22:20:35.075351 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 481/984] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:34 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:35.118745 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-65dadb4b-d2a0-42cd-be11-a3d0bafd211b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:35.126330 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-65dadb4b-d2a0-42cd-be11-a3d0bafd211b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1367 microversion: 2.1 time: 0.270447 Jul 22 22:20:35.127691 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 504/985] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:34 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:35.937599 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1e4ee336-8515-4836-98a0-3d99893ab9d2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:35.938185 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1e4ee336-8515-4836-98a0-3d99893ab9d2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:35.945323 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1e4ee336-8515-4836-98a0-3d99893ab9d2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:35.945766 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1e4ee336-8515-4836-98a0-3d99893ab9d2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:35.946529 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1e4ee336-8515-4836-98a0-3d99893ab9d2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:35.946958 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1e4ee336-8515-4836-98a0-3d99893ab9d2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:36.013586 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1e4ee336-8515-4836-98a0-3d99893ab9d2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:36.022222 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1e4ee336-8515-4836-98a0-3d99893ab9d2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1514 microversion: 2.1 time: 0.088713 Jul 22 22:20:36.022870 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 482/986] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:35 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1514 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:36.084540 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-34d4c5b9-fc61-40b6-8d0e-69c5d52a7f65 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:36.085856 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-34d4c5b9-fc61-40b6-8d0e-69c5d52a7f65 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:36.092420 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34d4c5b9-fc61-40b6-8d0e-69c5d52a7f65 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:36.093375 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34d4c5b9-fc61-40b6-8d0e-69c5d52a7f65 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:36.094182 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34d4c5b9-fc61-40b6-8d0e-69c5d52a7f65 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:36.094629 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-34d4c5b9-fc61-40b6-8d0e-69c5d52a7f65 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:36.144303 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ed87990a-d9d4-444b-8503-04f4ce616cb4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:36.145229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ed87990a-d9d4-444b-8503-04f4ce616cb4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:36.151789 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ed87990a-d9d4-444b-8503-04f4ce616cb4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:36.152818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ed87990a-d9d4-444b-8503-04f4ce616cb4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:36.153708 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ed87990a-d9d4-444b-8503-04f4ce616cb4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:36.154214 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ed87990a-d9d4-444b-8503-04f4ce616cb4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:36.232457 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-34d4c5b9-fc61-40b6-8d0e-69c5d52a7f65 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.152819 Jul 22 22:20:36.233257 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 505/987] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:36 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:36.239813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-b956f01e-a4e3-4ad1-8c11-592464da85b1 req-2b303193-3de3-426f-861e-95b5bbf50542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "230e9e16-9304-4b70-bf95-34811d9fd221", "name": "network-vif-deleted", "tag": "a11e48e2-13ab-49d9-9f7b-acdce4f4cd4f"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:36.242074 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:36.242074 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:20:36.250865 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-b956f01e-a4e3-4ad1-8c11-592464da85b1 req-2b303193-3de3-426f-861e-95b5bbf50542 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:36.251694 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-b956f01e-a4e3-4ad1-8c11-592464da85b1 req-2b303193-3de3-426f-861e-95b5bbf50542 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:36.288453 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-b956f01e-a4e3-4ad1-8c11-592464da85b1 req-2b303193-3de3-426f-861e-95b5bbf50542 service nova] Creating event network-vif-deleted:a11e48e2-13ab-49d9-9f7b-acdce4f4cd4f for instance 230e9e16-9304-4b70-bf95-34811d9fd221 on hv-cinder-80186 Jul 22 22:20:36.293950 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-b956f01e-a4e3-4ad1-8c11-592464da85b1 req-2b303193-3de3-426f-861e-95b5bbf50542 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059136 Jul 22 22:20:36.295650 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 506/988] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:20:36.332208 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ed87990a-d9d4-444b-8503-04f4ce616cb4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:36.340367 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ed87990a-d9d4-444b-8503-04f4ce616cb4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1367 microversion: 2.1 time: 0.199861 Jul 22 22:20:36.341033 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 483/989] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:36 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:37.040021 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2cfc9333-9e49-4eee-a068-c08bc509e128 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:37.040747 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2cfc9333-9e49-4eee-a068-c08bc509e128 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:37.047026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2cfc9333-9e49-4eee-a068-c08bc509e128 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:37.047474 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2cfc9333-9e49-4eee-a068-c08bc509e128 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:37.048814 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2cfc9333-9e49-4eee-a068-c08bc509e128 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:37.049368 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2cfc9333-9e49-4eee-a068-c08bc509e128 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:37.082089 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2cfc9333-9e49-4eee-a068-c08bc509e128 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:37.082530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2cfc9333-9e49-4eee-a068-c08bc509e128 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:37.082975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-2cfc9333-9e49-4eee-a068-c08bc509e128 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lazy-loading 'fault' on Instance uuid 230e9e16-9304-4b70-bf95-34811d9fd221 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:20:37.127541 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2cfc9333-9e49-4eee-a068-c08bc509e128 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:37.136223 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2cfc9333-9e49-4eee-a068-c08bc509e128 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 200 len: 1234 microversion: 2.1 time: 0.100253 Jul 22 22:20:37.136901 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 507/990] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:37 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 1234 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:37.243721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-279e08ac-3d38-4d01-a17b-694bdc417b85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:37.244906 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-279e08ac-3d38-4d01-a17b-694bdc417b85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:37.252006 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-279e08ac-3d38-4d01-a17b-694bdc417b85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:37.253384 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-279e08ac-3d38-4d01-a17b-694bdc417b85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:37.253926 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-279e08ac-3d38-4d01-a17b-694bdc417b85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:37.254512 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-279e08ac-3d38-4d01-a17b-694bdc417b85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:37.358455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6545baa0-0e7e-4e9f-93cd-14be8e3f6b99 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:37.359055 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6545baa0-0e7e-4e9f-93cd-14be8e3f6b99 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:37.366339 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-279e08ac-3d38-4d01-a17b-694bdc417b85 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.126261 Jul 22 22:20:37.366553 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6545baa0-0e7e-4e9f-93cd-14be8e3f6b99 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:37.366923 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6545baa0-0e7e-4e9f-93cd-14be8e3f6b99 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:37.367377 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 484/991] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:37 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:37.367685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6545baa0-0e7e-4e9f-93cd-14be8e3f6b99 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:37.368320 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6545baa0-0e7e-4e9f-93cd-14be8e3f6b99 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:37.530033 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6545baa0-0e7e-4e9f-93cd-14be8e3f6b99 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:37.538483 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6545baa0-0e7e-4e9f-93cd-14be8e3f6b99 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1367 microversion: 2.1 time: 0.183611 Jul 22 22:20:37.539064 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 508/992] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:37 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:38.155107 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c121b310-a1d0-40c2-9c2e-35d5fa5946e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:38.155785 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c121b310-a1d0-40c2-9c2e-35d5fa5946e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:38.163005 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c121b310-a1d0-40c2-9c2e-35d5fa5946e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:38.163458 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c121b310-a1d0-40c2-9c2e-35d5fa5946e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:38.164289 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c121b310-a1d0-40c2-9c2e-35d5fa5946e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:38.164732 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c121b310-a1d0-40c2-9c2e-35d5fa5946e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:38.179293 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-c121b310-a1d0-40c2-9c2e-35d5fa5946e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] HTTP exception thrown: Instance 230e9e16-9304-4b70-bf95-34811d9fd221 could not be found. Jul 22 22:20:38.179897 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c121b310-a1d0-40c2-9c2e-35d5fa5946e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Returning 404 to user: Instance 230e9e16-9304-4b70-bf95-34811d9fd221 could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:20:38.180771 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c121b310-a1d0-40c2-9c2e-35d5fa5946e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 404 len: 111 microversion: 2.1 time: 0.030328 Jul 22 22:20:38.181314 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 485/993] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:38 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:20:38.274655 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1807829774", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1673230260", "security_groups": [{"name": "tempest-secgroup-smoke-1993943540"}], "block_device_mapping_v2": [{"uuid": "0071f103-1072-41b2-8e6f-e8237c60f1a8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e529f4f-4b03-4451-832a-e468345894dd"}]}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:38.378505 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9a8d0cf7-4b4c-4ec8-afc7-5e81603f8872 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:38.379461 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9a8d0cf7-4b4c-4ec8-afc7-5e81603f8872 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:38.381611 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.network.neutron [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] validate_networks() for [('7e529f4f-4b03-4451-832a-e468345894dd', None, None, None)] {{(pid=107499) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:20:38.386146 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9a8d0cf7-4b4c-4ec8-afc7-5e81603f8872 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:38.386598 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9a8d0cf7-4b4c-4ec8-afc7-5e81603f8872 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:38.387384 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9a8d0cf7-4b4c-4ec8-afc7-5e81603f8872 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:38.387821 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9a8d0cf7-4b4c-4ec8-afc7-5e81603f8872 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:38.483071 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9a8d0cf7-4b4c-4ec8-afc7-5e81603f8872 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14 microversion: 2.20 time: 0.108982 Jul 22 22:20:38.483728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 486/994] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:38 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:38.556102 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cac86aaa-efc2-4aeb-83b8-ff4ba8d7b57f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:38.556820 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cac86aaa-efc2-4aeb-83b8-ff4ba8d7b57f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:38.563669 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cac86aaa-efc2-4aeb-83b8-ff4ba8d7b57f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:38.564103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cac86aaa-efc2-4aeb-83b8-ff4ba8d7b57f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:38.565463 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cac86aaa-efc2-4aeb-83b8-ff4ba8d7b57f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:38.565898 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cac86aaa-efc2-4aeb-83b8-ff4ba8d7b57f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:38.712945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cac86aaa-efc2-4aeb-83b8-ff4ba8d7b57f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:38.721245 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cac86aaa-efc2-4aeb-83b8-ff4ba8d7b57f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1367 microversion: 2.1 time: 0.169115 Jul 22 22:20:38.721993 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 487/995] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:38 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:38.787873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Flavor limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:20:38.788311 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Image limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:20:38.788785 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Flavor pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:20:38.789186 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Image pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:20:38.789586 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:20:38.799424 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:38.799895 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:38.800726 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:38.801152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:38.817829 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Getting quotas for project 853ea27311ea40e185ea767354f4dec1. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:20:38.821683 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Getting quotas for user 4af694abdd744df1beb130211b80774a and project 853ea27311ea40e185ea767354f4dec1. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:20:38.883625 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Going to run 1 instances... {{(pid=107499) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:20:38.885885 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0071f103-1072-41b2-8e6f-e8237c60f1a8',volume_size=None,volume_type=None)] {{(pid=107499) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:20:39.012907 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e001b669-cded-4ce7-9f92-24c6e06c611e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.741911 Jul 22 22:20:39.013724 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 509/996] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:20:38 2021] POST /compute/v2.1/servers => generated 408 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:20:39.023963 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6c3bf71e-06e3-4b9c-bdd3-710ea738e0f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:39.024922 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6c3bf71e-06e3-4b9c-bdd3-710ea738e0f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:39.083935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6c3bf71e-06e3-4b9c-bdd3-710ea738e0f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:39.090871 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6c3bf71e-06e3-4b9c-bdd3-710ea738e0f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1098 microversion: 2.1 time: 0.070461 Jul 22 22:20:39.091433 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 488/997] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:39 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1098 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:39.495026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-29912cd2-1966-41c1-98ca-6f7327ac1cac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:39.496092 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-29912cd2-1966-41c1-98ca-6f7327ac1cac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:39.504499 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-29912cd2-1966-41c1-98ca-6f7327ac1cac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:39.504949 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-29912cd2-1966-41c1-98ca-6f7327ac1cac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:39.505732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-29912cd2-1966-41c1-98ca-6f7327ac1cac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:39.506156 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-29912cd2-1966-41c1-98ca-6f7327ac1cac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:39.667036 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-29912cd2-1966-41c1-98ca-6f7327ac1cac tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 8355 microversion: 2.20 time: 0.176026 Jul 22 22:20:39.670412 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 510/998] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:39 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 8355 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:20:39.738358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7825c448-d297-4ed2-adf6-4f470d9c8357 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:39.739004 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7825c448-d297-4ed2-adf6-4f470d9c8357 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:39.745263 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7825c448-d297-4ed2-adf6-4f470d9c8357 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:39.745714 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7825c448-d297-4ed2-adf6-4f470d9c8357 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:39.746489 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7825c448-d297-4ed2-adf6-4f470d9c8357 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:39.746932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7825c448-d297-4ed2-adf6-4f470d9c8357 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:39.890596 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7825c448-d297-4ed2-adf6-4f470d9c8357 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:39.899446 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7825c448-d297-4ed2-adf6-4f470d9c8357 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1367 microversion: 2.1 time: 0.164941 Jul 22 22:20:39.900224 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 489/999] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:39 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:40.107262 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-48bc5ccd-bc8c-46fa-916c-f4d6ce7c0e85 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:40.107985 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-48bc5ccd-bc8c-46fa-916c-f4d6ce7c0e85 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:40.115787 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-48bc5ccd-bc8c-46fa-916c-f4d6ce7c0e85 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:40.116239 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-48bc5ccd-bc8c-46fa-916c-f4d6ce7c0e85 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:40.117031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-48bc5ccd-bc8c-46fa-916c-f4d6ce7c0e85 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:40.117461 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-48bc5ccd-bc8c-46fa-916c-f4d6ce7c0e85 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:40.189057 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-48bc5ccd-bc8c-46fa-916c-f4d6ce7c0e85 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:40.197074 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-48bc5ccd-bc8c-46fa-916c-f4d6ce7c0e85 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1196 microversion: 2.1 time: 0.093875 Jul 22 22:20:40.197627 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 511/1000] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:40 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1196 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:40.680092 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a5b5f5c7-8a7b-47aa-9e06-8c658c3a7cef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:40.681041 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a5b5f5c7-8a7b-47aa-9e06-8c658c3a7cef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:40.687399 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a5b5f5c7-8a7b-47aa-9e06-8c658c3a7cef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:40.688229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a5b5f5c7-8a7b-47aa-9e06-8c658c3a7cef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:40.690261 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a5b5f5c7-8a7b-47aa-9e06-8c658c3a7cef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:40.690880 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a5b5f5c7-8a7b-47aa-9e06-8c658c3a7cef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:40.812973 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a5b5f5c7-8a7b-47aa-9e06-8c658c3a7cef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 14250 microversion: 2.20 time: 0.137357 Jul 22 22:20:40.814228 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 490/1001] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:40 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 14250 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:40.915635 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-eb7d63c7-5176-4831-a158-3d6c02a65a96 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:40.916763 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-eb7d63c7-5176-4831-a158-3d6c02a65a96 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:40.929225 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb7d63c7-5176-4831-a158-3d6c02a65a96 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:40.931109 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb7d63c7-5176-4831-a158-3d6c02a65a96 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:40.932811 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb7d63c7-5176-4831-a158-3d6c02a65a96 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:40.933430 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb7d63c7-5176-4831-a158-3d6c02a65a96 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:41.202665 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-eb7d63c7-5176-4831-a158-3d6c02a65a96 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:41.214514 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-eb7d63c7-5176-4831-a158-3d6c02a65a96 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1367 microversion: 2.1 time: 0.302286 Jul 22 22:20:41.215883 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 512/1002] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:40 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1367 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:41.220007 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e0b1c8b8-9f43-444a-902d-0d9465c2ed87 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:41.221557 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e0b1c8b8-9f43-444a-902d-0d9465c2ed87 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:41.233055 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e0b1c8b8-9f43-444a-902d-0d9465c2ed87 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:41.234109 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e0b1c8b8-9f43-444a-902d-0d9465c2ed87 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:41.235640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e0b1c8b8-9f43-444a-902d-0d9465c2ed87 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:41.237534 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e0b1c8b8-9f43-444a-902d-0d9465c2ed87 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:41.368622 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-ff09081d-f2cc-43f9-81e5-598c08b99a1e req-7f0b3ebc-e213-4288-a6ff-ca4124873398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8f4f51-e0f7-44c6-9502-719ce8f4e606", "name": "network-vif-plugged", "status": "completed", "tag": "245b2585-5883-4ee1-ac31-1b72b9c0513b"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:41.373753 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:41.373753 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:20:41.382368 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-ff09081d-f2cc-43f9-81e5-598c08b99a1e req-7f0b3ebc-e213-4288-a6ff-ca4124873398 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:41.382900 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-ff09081d-f2cc-43f9-81e5-598c08b99a1e req-7f0b3ebc-e213-4288-a6ff-ca4124873398 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:41.398022 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-ff09081d-f2cc-43f9-81e5-598c08b99a1e req-7f0b3ebc-e213-4288-a6ff-ca4124873398 service nova] Creating event network-vif-plugged:245b2585-5883-4ee1-ac31-1b72b9c0513b for instance ba8f4f51-e0f7-44c6-9502-719ce8f4e606 on hv-cinder-80186 Jul 22 22:20:41.403935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e0b1c8b8-9f43-444a-902d-0d9465c2ed87 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:41.406296 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-ff09081d-f2cc-43f9-81e5-598c08b99a1e req-7f0b3ebc-e213-4288-a6ff-ca4124873398 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042569 Jul 22 22:20:41.407408 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 513/1003] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:20:41.412338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e0b1c8b8-9f43-444a-902d-0d9465c2ed87 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1282 microversion: 2.1 time: 0.200061 Jul 22 22:20:41.413131 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 491/1004] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:41 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1282 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:41.788031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-02e8b1b7-b7e3-4ed0-8795-1057deee1a0d req-a661e368-eaab-4951-bc1b-34883b50f6ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42179d6a-451f-4dca-83f8-042ff823e17c", "tag": "d51d96d5-7ed6-46ea-ac2b-42c80c4d2a76"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:41.789637 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:41.789637 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:20:41.797451 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-02e8b1b7-b7e3-4ed0-8795-1057deee1a0d req-a661e368-eaab-4951-bc1b-34883b50f6ba service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:41.797894 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-02e8b1b7-b7e3-4ed0-8795-1057deee1a0d req-a661e368-eaab-4951-bc1b-34883b50f6ba service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:41.816524 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-02e8b1b7-b7e3-4ed0-8795-1057deee1a0d req-a661e368-eaab-4951-bc1b-34883b50f6ba service nova] Creating event network-changed:d51d96d5-7ed6-46ea-ac2b-42c80c4d2a76 for instance 42179d6a-451f-4dca-83f8-042ff823e17c on hv-cinder-80186 Jul 22 22:20:41.821772 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-02e8b1b7-b7e3-4ed0-8795-1057deee1a0d req-a661e368-eaab-4951-bc1b-34883b50f6ba service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038861 Jul 22 22:20:41.822505 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 514/1005] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:20:41.825762 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-197eecff-a03a-4e39-bc58-91622a2c79d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:41.826712 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-197eecff-a03a-4e39-bc58-91622a2c79d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:41.833048 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-197eecff-a03a-4e39-bc58-91622a2c79d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:41.833594 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-197eecff-a03a-4e39-bc58-91622a2c79d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:41.834380 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-197eecff-a03a-4e39-bc58-91622a2c79d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:41.834813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-197eecff-a03a-4e39-bc58-91622a2c79d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:42.231664 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-37f05981-716b-42a8-b9c4-5bb81a218f87 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:42.232383 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-37f05981-716b-42a8-b9c4-5bb81a218f87 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:42.239633 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37f05981-716b-42a8-b9c4-5bb81a218f87 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:42.240073 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37f05981-716b-42a8-b9c4-5bb81a218f87 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:42.240868 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37f05981-716b-42a8-b9c4-5bb81a218f87 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:42.241292 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-37f05981-716b-42a8-b9c4-5bb81a218f87 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:42.296962 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-197eecff-a03a-4e39-bc58-91622a2c79d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 18030 microversion: 2.20 time: 0.474906 Jul 22 22:20:42.297614 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 492/1006] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:41 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 18030 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:20:42.425939 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-37f05981-716b-42a8-b9c4-5bb81a218f87 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:42.429993 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7d77c378-05d6-4ba5-9192-87460a65a21b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:42.430700 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7d77c378-05d6-4ba5-9192-87460a65a21b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:42.433788 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-37f05981-716b-42a8-b9c4-5bb81a218f87 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1367 microversion: 2.1 time: 0.206032 Jul 22 22:20:42.434366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 515/1007] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:42 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:42.437634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7d77c378-05d6-4ba5-9192-87460a65a21b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:42.438232 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7d77c378-05d6-4ba5-9192-87460a65a21b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:42.439925 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7d77c378-05d6-4ba5-9192-87460a65a21b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:42.440708 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7d77c378-05d6-4ba5-9192-87460a65a21b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:42.578671 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7d77c378-05d6-4ba5-9192-87460a65a21b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:42.586529 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7d77c378-05d6-4ba5-9192-87460a65a21b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.160591 Jul 22 22:20:42.587094 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 493/1008] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:42 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:43.309046 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bd0483fd-0a0a-4fed-b7ea-eeca5e7faa53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:43.310136 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-bd0483fd-0a0a-4fed-b7ea-eeca5e7faa53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:43.317226 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bd0483fd-0a0a-4fed-b7ea-eeca5e7faa53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:43.317676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bd0483fd-0a0a-4fed-b7ea-eeca5e7faa53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:43.318469 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bd0483fd-0a0a-4fed-b7ea-eeca5e7faa53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:43.318894 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bd0483fd-0a0a-4fed-b7ea-eeca5e7faa53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:43.452926 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-29e58c5d-118e-43e3-a81e-2a387448ac54 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:43.454711 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-29e58c5d-118e-43e3-a81e-2a387448ac54 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:43.462386 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-29e58c5d-118e-43e3-a81e-2a387448ac54 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:43.462832 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-29e58c5d-118e-43e3-a81e-2a387448ac54 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:43.463601 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-29e58c5d-118e-43e3-a81e-2a387448ac54 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:43.464029 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-29e58c5d-118e-43e3-a81e-2a387448ac54 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:43.602541 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-bd0483fd-0a0a-4fed-b7ea-eeca5e7faa53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 18561 microversion: 2.20 time: 0.297005 Jul 22 22:20:43.603372 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 516/1009] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:43 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 18561 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:43.608236 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-11bba0c5-b718-44bd-99ec-fd8c54350451 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:43.609196 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-11bba0c5-b718-44bd-99ec-fd8c54350451 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:43.610360 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-29e58c5d-118e-43e3-a81e-2a387448ac54 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:43.615556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-11bba0c5-b718-44bd-99ec-fd8c54350451 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:43.616006 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-11bba0c5-b718-44bd-99ec-fd8c54350451 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:43.616801 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-11bba0c5-b718-44bd-99ec-fd8c54350451 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:43.617265 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-11bba0c5-b718-44bd-99ec-fd8c54350451 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:43.618390 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-29e58c5d-118e-43e3-a81e-2a387448ac54 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1553 microversion: 2.1 time: 0.170718 Jul 22 22:20:43.619026 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 494/1010] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:43 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:43.634833 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-94d35352-aca7-41ce-8e37-b49935f38cfd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:43.635431 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-94d35352-aca7-41ce-8e37-b49935f38cfd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:43.641408 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-94d35352-aca7-41ce-8e37-b49935f38cfd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:43.641933 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-94d35352-aca7-41ce-8e37-b49935f38cfd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:43.642775 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-94d35352-aca7-41ce-8e37-b49935f38cfd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:43.643823 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-94d35352-aca7-41ce-8e37-b49935f38cfd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:43.746467 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-94d35352-aca7-41ce-8e37-b49935f38cfd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115233 Jul 22 22:20:43.747141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 495/1011] 10.222.0.110 () {58 vars in 1280 bytes} [Thu Jul 22 22:20:43 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:20:43.762568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-11bba0c5-b718-44bd-99ec-fd8c54350451 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:43.770908 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-11bba0c5-b718-44bd-99ec-fd8c54350451 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.166467 Jul 22 22:20:43.771586 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 517/1012] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:43 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:44.614937 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d779fd22-ee1e-4814-9dee-2b541adf1832 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:44.615896 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d779fd22-ee1e-4814-9dee-2b541adf1832 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:44.622466 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d779fd22-ee1e-4814-9dee-2b541adf1832 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:44.622904 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d779fd22-ee1e-4814-9dee-2b541adf1832 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:44.623837 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d779fd22-ee1e-4814-9dee-2b541adf1832 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:44.624301 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d779fd22-ee1e-4814-9dee-2b541adf1832 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:44.753987 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d779fd22-ee1e-4814-9dee-2b541adf1832 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 20271 microversion: 2.20 time: 0.143081 Jul 22 22:20:44.755515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 496/1013] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:44 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 20271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:20:44.776131 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7e978e92-7424-4674-bd11-3c4c94df0eab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:44.779063 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7e978e92-7424-4674-bd11-3c4c94df0eab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:44.782977 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-a500328a-7d26-4328-b2d2-4fda7d4d6275 req-e5c69c74-4506-4ace-acae-1cce7a92b04b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8f4f51-e0f7-44c6-9502-719ce8f4e606", "tag": "245b2585-5883-4ee1-ac31-1b72b9c0513b"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:44.784629 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:44.784629 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:20:44.786041 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e978e92-7424-4674-bd11-3c4c94df0eab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:44.786470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e978e92-7424-4674-bd11-3c4c94df0eab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:44.787255 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e978e92-7424-4674-bd11-3c4c94df0eab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:44.787681 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e978e92-7424-4674-bd11-3c4c94df0eab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:44.792973 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-a500328a-7d26-4328-b2d2-4fda7d4d6275 req-e5c69c74-4506-4ace-acae-1cce7a92b04b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:44.793516 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-a500328a-7d26-4328-b2d2-4fda7d4d6275 req-e5c69c74-4506-4ace-acae-1cce7a92b04b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:44.807569 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-a500328a-7d26-4328-b2d2-4fda7d4d6275 req-e5c69c74-4506-4ace-acae-1cce7a92b04b service nova] Creating event network-changed:245b2585-5883-4ee1-ac31-1b72b9c0513b for instance ba8f4f51-e0f7-44c6-9502-719ce8f4e606 on hv-cinder-80186 Jul 22 22:20:44.816989 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-a500328a-7d26-4328-b2d2-4fda7d4d6275 req-e5c69c74-4506-4ace-acae-1cce7a92b04b service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038419 Jul 22 22:20:44.817597 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 497/1014] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:20:44.825971 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-39a149a1-020a-41dc-9c83-831e2702b411 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:44.826669 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-39a149a1-020a-41dc-9c83-831e2702b411 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:44.833843 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39a149a1-020a-41dc-9c83-831e2702b411 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:44.835200 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39a149a1-020a-41dc-9c83-831e2702b411 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:44.835358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39a149a1-020a-41dc-9c83-831e2702b411 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:44.835797 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39a149a1-020a-41dc-9c83-831e2702b411 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:44.927965 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7e978e92-7424-4674-bd11-3c4c94df0eab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.156219 Jul 22 22:20:44.931840 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 518/1015] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:44 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:20:44.995114 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-39a149a1-020a-41dc-9c83-831e2702b411 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:45.007086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-39a149a1-020a-41dc-9c83-831e2702b411 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.184957 Jul 22 22:20:45.008124 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 498/1016] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:44 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:45.766874 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-766df4fe-a8eb-4e3a-b787-a71ebfd2c9be tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:45.768028 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-766df4fe-a8eb-4e3a-b787-a71ebfd2c9be tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:45.778711 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-766df4fe-a8eb-4e3a-b787-a71ebfd2c9be tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:45.779422 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-766df4fe-a8eb-4e3a-b787-a71ebfd2c9be tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:45.780195 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-766df4fe-a8eb-4e3a-b787-a71ebfd2c9be tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:45.780718 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-766df4fe-a8eb-4e3a-b787-a71ebfd2c9be tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:45.915412 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-766df4fe-a8eb-4e3a-b787-a71ebfd2c9be tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 22534 microversion: 2.20 time: 0.152913 Jul 22 22:20:45.916069 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 519/1017] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:45 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 22534 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:45.939023 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d7f3fc33-f65c-4af5-99ed-7ae0044c288c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:45.940889 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d7f3fc33-f65c-4af5-99ed-7ae0044c288c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:45.947591 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7f3fc33-f65c-4af5-99ed-7ae0044c288c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:45.948036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7f3fc33-f65c-4af5-99ed-7ae0044c288c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:45.948849 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7f3fc33-f65c-4af5-99ed-7ae0044c288c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:45.949284 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7f3fc33-f65c-4af5-99ed-7ae0044c288c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:46.025429 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8852283a-58ca-44a4-beaf-978c2943d7f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:46.026120 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8852283a-58ca-44a4-beaf-978c2943d7f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:46.032975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8852283a-58ca-44a4-beaf-978c2943d7f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:46.033360 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8852283a-58ca-44a4-beaf-978c2943d7f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:46.034798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8852283a-58ca-44a4-beaf-978c2943d7f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:46.035228 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8852283a-58ca-44a4-beaf-978c2943d7f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:46.060048 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d7f3fc33-f65c-4af5-99ed-7ae0044c288c tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.124620 Jul 22 22:20:46.063443 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 499/1018] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:45 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:20:46.173145 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8852283a-58ca-44a4-beaf-978c2943d7f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:46.180739 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8852283a-58ca-44a4-beaf-978c2943d7f4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.159288 Jul 22 22:20:46.181298 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 520/1019] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:46 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:46.929769 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-260d34f7-f92c-47de-ac32-235b27fe65a1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:46.930759 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-260d34f7-f92c-47de-ac32-235b27fe65a1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:46.937229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-260d34f7-f92c-47de-ac32-235b27fe65a1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:46.937676 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-260d34f7-f92c-47de-ac32-235b27fe65a1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:46.938452 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-260d34f7-f92c-47de-ac32-235b27fe65a1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:46.938885 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-260d34f7-f92c-47de-ac32-235b27fe65a1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:47.055456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-260d34f7-f92c-47de-ac32-235b27fe65a1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 23429 microversion: 2.20 time: 0.129528 Jul 22 22:20:47.056248 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 500/1020] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:46 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 23429 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:47.070468 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7e721b33-da7f-4fd9-b2ce-630c243e7770 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:47.071416 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7e721b33-da7f-4fd9-b2ce-630c243e7770 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:47.077875 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e721b33-da7f-4fd9-b2ce-630c243e7770 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:47.078311 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e721b33-da7f-4fd9-b2ce-630c243e7770 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:47.079070 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e721b33-da7f-4fd9-b2ce-630c243e7770 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:47.079498 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e721b33-da7f-4fd9-b2ce-630c243e7770 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:47.194007 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7e721b33-da7f-4fd9-b2ce-630c243e7770 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.127029 Jul 22 22:20:47.197144 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 521/1021] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:47 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:20:47.197550 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0306fbb3-db89-4e39-9601-8ff719bb2210 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:47.198253 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0306fbb3-db89-4e39-9601-8ff719bb2210 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:47.204818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0306fbb3-db89-4e39-9601-8ff719bb2210 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:47.205267 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0306fbb3-db89-4e39-9601-8ff719bb2210 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:47.206359 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0306fbb3-db89-4e39-9601-8ff719bb2210 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:47.206891 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0306fbb3-db89-4e39-9601-8ff719bb2210 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:47.350071 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0306fbb3-db89-4e39-9601-8ff719bb2210 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:47.357378 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0306fbb3-db89-4e39-9601-8ff719bb2210 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.163932 Jul 22 22:20:47.357934 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 501/1022] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:47 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:48.068636 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-cdd445aa-661c-4dba-b984-654a402fabc4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:48.069696 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-cdd445aa-661c-4dba-b984-654a402fabc4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:48.076212 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cdd445aa-661c-4dba-b984-654a402fabc4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:48.076806 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cdd445aa-661c-4dba-b984-654a402fabc4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:48.077463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cdd445aa-661c-4dba-b984-654a402fabc4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:48.077901 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cdd445aa-661c-4dba-b984-654a402fabc4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:48.204738 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-cdd445aa-661c-4dba-b984-654a402fabc4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 24566 microversion: 2.20 time: 0.141035 Jul 22 22:20:48.205059 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c24496e0-1c6f-47b5-acd5-e93c782d10fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:48.205512 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 522/1023] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:48 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 24566 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:48.206531 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c24496e0-1c6f-47b5-acd5-e93c782d10fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:48.213721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c24496e0-1c6f-47b5-acd5-e93c782d10fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:48.214174 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c24496e0-1c6f-47b5-acd5-e93c782d10fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:48.214955 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c24496e0-1c6f-47b5-acd5-e93c782d10fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:48.215394 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c24496e0-1c6f-47b5-acd5-e93c782d10fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:48.329159 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c24496e0-1c6f-47b5-acd5-e93c782d10fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.128507 Jul 22 22:20:48.329789 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 502/1024] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:48 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:20:48.374412 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0d19f563-610b-4499-9f78-a83c80458400 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:48.375103 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0d19f563-610b-4499-9f78-a83c80458400 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:48.381825 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d19f563-610b-4499-9f78-a83c80458400 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:48.382270 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d19f563-610b-4499-9f78-a83c80458400 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:48.383091 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d19f563-610b-4499-9f78-a83c80458400 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:48.383540 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0d19f563-610b-4499-9f78-a83c80458400 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:48.528680 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-0d19f563-610b-4499-9f78-a83c80458400 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:48.536623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0d19f563-610b-4499-9f78-a83c80458400 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.166196 Jul 22 22:20:48.537179 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 523/1025] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:48 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:49.218505 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f3fe58f7-3a0e-4075-8c2b-dc5d939a09b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:49.219492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f3fe58f7-3a0e-4075-8c2b-dc5d939a09b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:49.226193 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f3fe58f7-3a0e-4075-8c2b-dc5d939a09b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:49.226634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f3fe58f7-3a0e-4075-8c2b-dc5d939a09b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:49.227442 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f3fe58f7-3a0e-4075-8c2b-dc5d939a09b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:49.227871 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f3fe58f7-3a0e-4075-8c2b-dc5d939a09b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:49.339226 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ca938248-b588-48a0-b413-e2ccdd540c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:49.340156 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ca938248-b588-48a0-b413-e2ccdd540c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:49.346253 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ca938248-b588-48a0-b413-e2ccdd540c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:49.346700 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ca938248-b588-48a0-b413-e2ccdd540c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:49.347948 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ca938248-b588-48a0-b413-e2ccdd540c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:49.348476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ca938248-b588-48a0-b413-e2ccdd540c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:49.363906 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f3fe58f7-3a0e-4075-8c2b-dc5d939a09b1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 25786 microversion: 2.20 time: 0.149261 Jul 22 22:20:49.364578 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 503/1026] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:49 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 25786 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:49.463738 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ca938248-b588-48a0-b413-e2ccdd540c29 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.127899 Jul 22 22:20:49.464309 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 524/1027] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:49 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:20:49.553402 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7bfdd681-dc29-42b1-950e-1fc54d6c3003 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:49.554092 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7bfdd681-dc29-42b1-950e-1fc54d6c3003 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:49.560568 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7bfdd681-dc29-42b1-950e-1fc54d6c3003 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:49.561011 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7bfdd681-dc29-42b1-950e-1fc54d6c3003 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:49.561764 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7bfdd681-dc29-42b1-950e-1fc54d6c3003 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:49.562191 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7bfdd681-dc29-42b1-950e-1fc54d6c3003 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:49.697802 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7bfdd681-dc29-42b1-950e-1fc54d6c3003 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:49.705104 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7bfdd681-dc29-42b1-950e-1fc54d6c3003 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.156244 Jul 22 22:20:49.705669 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 504/1028] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:49 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:50.376851 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a591bdf7-e807-4ce0-a005-761ad8f54d8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:50.377810 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a591bdf7-e807-4ce0-a005-761ad8f54d8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:50.384863 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a591bdf7-e807-4ce0-a005-761ad8f54d8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:50.385309 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a591bdf7-e807-4ce0-a005-761ad8f54d8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:50.386093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a591bdf7-e807-4ce0-a005-761ad8f54d8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:50.386531 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a591bdf7-e807-4ce0-a005-761ad8f54d8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:50.474919 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0ced3b47-00c4-4215-9a55-c2db1a3be759 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:50.475916 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0ced3b47-00c4-4215-9a55-c2db1a3be759 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:50.488796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ced3b47-00c4-4215-9a55-c2db1a3be759 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:50.489601 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ced3b47-00c4-4215-9a55-c2db1a3be759 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:50.490410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ced3b47-00c4-4215-9a55-c2db1a3be759 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:50.490836 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0ced3b47-00c4-4215-9a55-c2db1a3be759 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:50.520798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a591bdf7-e807-4ce0-a005-761ad8f54d8a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 26599 microversion: 2.20 time: 0.147894 Jul 22 22:20:50.521679 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 525/1029] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:50 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 26599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:50.599597 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0ced3b47-00c4-4215-9a55-c2db1a3be759 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.128715 Jul 22 22:20:50.600220 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 505/1030] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:50 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:20:50.722791 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8faa3e3c-57f1-4c65-afd8-662b0ed2ca26 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:50.723373 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8faa3e3c-57f1-4c65-afd8-662b0ed2ca26 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:50.729766 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8faa3e3c-57f1-4c65-afd8-662b0ed2ca26 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:50.730203 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8faa3e3c-57f1-4c65-afd8-662b0ed2ca26 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:50.730955 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8faa3e3c-57f1-4c65-afd8-662b0ed2ca26 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:50.731378 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8faa3e3c-57f1-4c65-afd8-662b0ed2ca26 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:50.866692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8faa3e3c-57f1-4c65-afd8-662b0ed2ca26 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:50.874097 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8faa3e3c-57f1-4c65-afd8-662b0ed2ca26 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.155558 Jul 22 22:20:50.874664 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 526/1031] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:50 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:51.533141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-95a8b73a-7d79-48c9-99a0-7d66db685e81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:51.534091 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-95a8b73a-7d79-48c9-99a0-7d66db685e81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:51.541398 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95a8b73a-7d79-48c9-99a0-7d66db685e81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:51.541848 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95a8b73a-7d79-48c9-99a0-7d66db685e81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:51.542629 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95a8b73a-7d79-48c9-99a0-7d66db685e81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:51.543153 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95a8b73a-7d79-48c9-99a0-7d66db685e81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:51.610578 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e44342f7-4392-4f14-a8e3-737d95cfe679 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:51.611470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e44342f7-4392-4f14-a8e3-737d95cfe679 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:51.618323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e44342f7-4392-4f14-a8e3-737d95cfe679 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:51.618765 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e44342f7-4392-4f14-a8e3-737d95cfe679 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:51.619534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e44342f7-4392-4f14-a8e3-737d95cfe679 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:51.619963 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e44342f7-4392-4f14-a8e3-737d95cfe679 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:51.665222 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-95a8b73a-7d79-48c9-99a0-7d66db685e81 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 27408 microversion: 2.20 time: 0.136044 Jul 22 22:20:51.666113 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 506/1032] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:51 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 27408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:51.744454 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e44342f7-4392-4f14-a8e3-737d95cfe679 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.137334 Jul 22 22:20:51.745257 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 527/1033] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:51 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 22 22:20:51.891251 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6a81fb9c-8f44-4db3-899c-d283c7d164b9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:51.892358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6a81fb9c-8f44-4db3-899c-d283c7d164b9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:51.899019 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6a81fb9c-8f44-4db3-899c-d283c7d164b9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:51.899465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6a81fb9c-8f44-4db3-899c-d283c7d164b9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:51.900224 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6a81fb9c-8f44-4db3-899c-d283c7d164b9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:51.900688 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6a81fb9c-8f44-4db3-899c-d283c7d164b9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:52.049049 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6a81fb9c-8f44-4db3-899c-d283c7d164b9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:52.056952 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6a81fb9c-8f44-4db3-899c-d283c7d164b9 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.169763 Jul 22 22:20:52.057514 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 507/1034] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:51 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:52.677842 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3666e52a-c119-4b21-a3d3-30955f38e878 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:52.678873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3666e52a-c119-4b21-a3d3-30955f38e878 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:52.685512 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3666e52a-c119-4b21-a3d3-30955f38e878 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:52.685986 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3666e52a-c119-4b21-a3d3-30955f38e878 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:52.686763 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3666e52a-c119-4b21-a3d3-30955f38e878 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:52.687195 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3666e52a-c119-4b21-a3d3-30955f38e878 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:52.755325 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4f1b83dc-2a24-408a-a417-2a64ffb7e1b0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:52.756235 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4f1b83dc-2a24-408a-a417-2a64ffb7e1b0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:52.762378 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f1b83dc-2a24-408a-a417-2a64ffb7e1b0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:52.762819 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f1b83dc-2a24-408a-a417-2a64ffb7e1b0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:52.763584 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f1b83dc-2a24-408a-a417-2a64ffb7e1b0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:52.764037 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f1b83dc-2a24-408a-a417-2a64ffb7e1b0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:52.821534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3666e52a-c119-4b21-a3d3-30955f38e878 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 27764 microversion: 2.20 time: 0.147892 Jul 22 22:20:52.822424 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 528/1035] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:52 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 27764 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:52.914671 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4f1b83dc-2a24-408a-a417-2a64ffb7e1b0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.162980 Jul 22 22:20:52.915445 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 508/1036] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:52 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:20:53.074273 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-28a722d8-b9a1-4198-9722-f5df51676cf4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:53.074980 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-28a722d8-b9a1-4198-9722-f5df51676cf4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:53.081415 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-28a722d8-b9a1-4198-9722-f5df51676cf4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:53.081867 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-28a722d8-b9a1-4198-9722-f5df51676cf4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:53.082641 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-28a722d8-b9a1-4198-9722-f5df51676cf4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:53.084073 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-28a722d8-b9a1-4198-9722-f5df51676cf4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:53.226485 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-28a722d8-b9a1-4198-9722-f5df51676cf4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:53.234057 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-28a722d8-b9a1-4198-9722-f5df51676cf4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.163770 Jul 22 22:20:53.234640 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 529/1037] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:53 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:53.833757 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-582a3f86-b50b-4cd5-a277-ed59a97ff329 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:53.835341 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-582a3f86-b50b-4cd5-a277-ed59a97ff329 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:53.841955 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-582a3f86-b50b-4cd5-a277-ed59a97ff329 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:53.842405 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-582a3f86-b50b-4cd5-a277-ed59a97ff329 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:53.843235 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-582a3f86-b50b-4cd5-a277-ed59a97ff329 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:53.843627 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-582a3f86-b50b-4cd5-a277-ed59a97ff329 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:53.925383 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c5ceb57e-15f7-4d93-84d8-de8ab6756995 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:53.926202 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c5ceb57e-15f7-4d93-84d8-de8ab6756995 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:53.932975 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c5ceb57e-15f7-4d93-84d8-de8ab6756995 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:53.933417 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c5ceb57e-15f7-4d93-84d8-de8ab6756995 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:53.934190 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c5ceb57e-15f7-4d93-84d8-de8ab6756995 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:53.934619 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c5ceb57e-15f7-4d93-84d8-de8ab6756995 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:53.972042 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-582a3f86-b50b-4cd5-a277-ed59a97ff329 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 28014 microversion: 2.20 time: 0.142252 Jul 22 22:20:53.972737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 509/1038] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:53 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 28014 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:54.054246 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c5ceb57e-15f7-4d93-84d8-de8ab6756995 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.131999 Jul 22 22:20:54.054986 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 530/1039] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:53 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:20:54.250993 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4cdd7f24-663e-4b68-bbbd-bcac83bb88d5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:54.251600 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4cdd7f24-663e-4b68-bbbd-bcac83bb88d5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:54.258752 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4cdd7f24-663e-4b68-bbbd-bcac83bb88d5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:54.259205 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4cdd7f24-663e-4b68-bbbd-bcac83bb88d5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:54.259979 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4cdd7f24-663e-4b68-bbbd-bcac83bb88d5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:54.260439 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4cdd7f24-663e-4b68-bbbd-bcac83bb88d5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:54.400122 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4cdd7f24-663e-4b68-bbbd-bcac83bb88d5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:54.407586 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4cdd7f24-663e-4b68-bbbd-bcac83bb88d5 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.160701 Jul 22 22:20:54.408148 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 510/1040] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:54 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:54.985005 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ff5c83d4-e862-4704-97e3-b2e18ad1cb42 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:54.985983 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ff5c83d4-e862-4704-97e3-b2e18ad1cb42 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:54.993523 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff5c83d4-e862-4704-97e3-b2e18ad1cb42 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:54.993961 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff5c83d4-e862-4704-97e3-b2e18ad1cb42 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:54.994716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff5c83d4-e862-4704-97e3-b2e18ad1cb42 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:54.995141 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff5c83d4-e862-4704-97e3-b2e18ad1cb42 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:55.065271 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-dcdd10de-1542-4c7d-8ab1-56f725516d92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:55.066186 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-dcdd10de-1542-4c7d-8ab1-56f725516d92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:55.073508 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dcdd10de-1542-4c7d-8ab1-56f725516d92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:55.074014 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dcdd10de-1542-4c7d-8ab1-56f725516d92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:55.074792 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dcdd10de-1542-4c7d-8ab1-56f725516d92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:55.075230 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-dcdd10de-1542-4c7d-8ab1-56f725516d92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:55.120732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ff5c83d4-e862-4704-97e3-b2e18ad1cb42 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 28183 microversion: 2.20 time: 0.139752 Jul 22 22:20:55.123353 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 531/1041] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:54 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 28183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:55.194837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-29452b34-50c6-4d3b-82cd-e3af95f07d20 req-4297edc3-0649-45e3-aef2-bc1e51aba101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42179d6a-451f-4dca-83f8-042ff823e17c", "name": "network-vif-plugged", "status": "completed", "tag": "d51d96d5-7ed6-46ea-ac2b-42c80c4d2a76"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:55.196678 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:55.196678 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:20:55.199643 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-dcdd10de-1542-4c7d-8ab1-56f725516d92 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.138066 Jul 22 22:20:55.200477 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 511/1042] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:55 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:20:55.204439 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-29452b34-50c6-4d3b-82cd-e3af95f07d20 req-4297edc3-0649-45e3-aef2-bc1e51aba101 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:55.204944 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-29452b34-50c6-4d3b-82cd-e3af95f07d20 req-4297edc3-0649-45e3-aef2-bc1e51aba101 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:55.216795 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-29452b34-50c6-4d3b-82cd-e3af95f07d20 req-4297edc3-0649-45e3-aef2-bc1e51aba101 service nova] Creating event network-vif-plugged:d51d96d5-7ed6-46ea-ac2b-42c80c4d2a76 for instance 42179d6a-451f-4dca-83f8-042ff823e17c on hv-cinder-80186 Jul 22 22:20:55.221468 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-29452b34-50c6-4d3b-82cd-e3af95f07d20 req-4297edc3-0649-45e3-aef2-bc1e51aba101 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031336 Jul 22 22:20:55.222064 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 532/1043] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:20:55.425194 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-eceb1364-c8fa-46ff-9947-2eb1851c541a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:55.425909 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-eceb1364-c8fa-46ff-9947-2eb1851c541a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:55.433337 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eceb1364-c8fa-46ff-9947-2eb1851c541a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:55.433883 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eceb1364-c8fa-46ff-9947-2eb1851c541a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:55.434773 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eceb1364-c8fa-46ff-9947-2eb1851c541a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:55.435236 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eceb1364-c8fa-46ff-9947-2eb1851c541a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:55.574717 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-eceb1364-c8fa-46ff-9947-2eb1851c541a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:55.582098 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-eceb1364-c8fa-46ff-9947-2eb1851c541a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.161648 Jul 22 22:20:55.582672 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 512/1044] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:55 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:56.134133 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-46f42e98-cee9-4e0a-a4fd-641f09e332ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:56.135121 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-46f42e98-cee9-4e0a-a4fd-641f09e332ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:56.141272 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-46f42e98-cee9-4e0a-a4fd-641f09e332ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:56.141721 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-46f42e98-cee9-4e0a-a4fd-641f09e332ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:56.142499 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-46f42e98-cee9-4e0a-a4fd-641f09e332ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:56.142932 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-46f42e98-cee9-4e0a-a4fd-641f09e332ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:56.211279 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-95d62fb5-152b-4b47-ae76-2635bff50832 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:56.212194 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-95d62fb5-152b-4b47-ae76-2635bff50832 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:56.218164 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95d62fb5-152b-4b47-ae76-2635bff50832 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:56.218607 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95d62fb5-152b-4b47-ae76-2635bff50832 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:56.219381 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95d62fb5-152b-4b47-ae76-2635bff50832 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:56.219818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-95d62fb5-152b-4b47-ae76-2635bff50832 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:56.263163 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-46f42e98-cee9-4e0a-a4fd-641f09e332ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 28183 microversion: 2.20 time: 0.133834 Jul 22 22:20:56.264615 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 533/1045] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:56 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 28183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:56.345164 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-95d62fb5-152b-4b47-ae76-2635bff50832 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.138211 Jul 22 22:20:56.345788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 513/1046] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:56 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:20:56.601123 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b9b428d1-40c6-492d-aaa2-03f6cf85f607 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:56.601819 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b9b428d1-40c6-492d-aaa2-03f6cf85f607 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:56.608244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b9b428d1-40c6-492d-aaa2-03f6cf85f607 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:56.608718 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b9b428d1-40c6-492d-aaa2-03f6cf85f607 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:56.609481 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b9b428d1-40c6-492d-aaa2-03f6cf85f607 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:56.609915 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b9b428d1-40c6-492d-aaa2-03f6cf85f607 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:56.749009 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b9b428d1-40c6-492d-aaa2-03f6cf85f607 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:56.756918 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b9b428d1-40c6-492d-aaa2-03f6cf85f607 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1270 microversion: 2.1 time: 0.159992 Jul 22 22:20:56.757482 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 534/1047] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:56 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1270 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:57.276693 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-28673c00-702b-48dd-bed3-191adda1b1b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:57.277693 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-28673c00-702b-48dd-bed3-191adda1b1b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:57.284260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-28673c00-702b-48dd-bed3-191adda1b1b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:57.284737 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-28673c00-702b-48dd-bed3-191adda1b1b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:57.285515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-28673c00-702b-48dd-bed3-191adda1b1b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:57.285953 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-28673c00-702b-48dd-bed3-191adda1b1b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:57.356566 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7683804d-2579-4049-9cec-5917b4e6bba7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:57.357469 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7683804d-2579-4049-9cec-5917b4e6bba7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:57.363289 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7683804d-2579-4049-9cec-5917b4e6bba7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:57.363728 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7683804d-2579-4049-9cec-5917b4e6bba7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:57.364531 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7683804d-2579-4049-9cec-5917b4e6bba7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:57.364962 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7683804d-2579-4049-9cec-5917b4e6bba7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:57.480973 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-28673c00-702b-48dd-bed3-191adda1b1b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 28373 microversion: 2.20 time: 0.208149 Jul 22 22:20:57.481538 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 514/1048] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:57 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 28373 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:57.519857 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7683804d-2579-4049-9cec-5917b4e6bba7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 14 microversion: 2.1 time: 0.166802 Jul 22 22:20:57.520529 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 535/1049] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:57 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 22 22:20:57.774393 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a0dbbf9c-e2ca-44eb-bd81-f8192d2ef743 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:57.774994 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a0dbbf9c-e2ca-44eb-bd81-f8192d2ef743 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:57.781414 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a0dbbf9c-e2ca-44eb-bd81-f8192d2ef743 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:57.781854 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a0dbbf9c-e2ca-44eb-bd81-f8192d2ef743 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:57.782612 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a0dbbf9c-e2ca-44eb-bd81-f8192d2ef743 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:57.783042 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a0dbbf9c-e2ca-44eb-bd81-f8192d2ef743 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:57.926145 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a0dbbf9c-e2ca-44eb-bd81-f8192d2ef743 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:57.934141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a0dbbf9c-e2ca-44eb-bd81-f8192d2ef743 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1458 microversion: 2.1 time: 0.164539 Jul 22 22:20:57.934696 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 515/1050] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:57 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1458 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:57.950393 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-26def3fa-5744-4446-8df0-e187ac1faead tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:20:57.951086 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-26def3fa-5744-4446-8df0-e187ac1faead tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:57.957668 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-26def3fa-5744-4446-8df0-e187ac1faead tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:57.958120 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-26def3fa-5744-4446-8df0-e187ac1faead tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:57.959154 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-26def3fa-5744-4446-8df0-e187ac1faead tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:57.959585 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-26def3fa-5744-4446-8df0-e187ac1faead tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:58.101426 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-26def3fa-5744-4446-8df0-e187ac1faead tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:20:58.109812 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-26def3fa-5744-4446-8df0-e187ac1faead tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1458 microversion: 2.1 time: 0.163310 Jul 22 22:20:58.110402 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 536/1051] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:20:57 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1458 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:20:58.493170 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b31ac575-6802-49a0-a270-517cefe4e9c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:58.494116 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b31ac575-6802-49a0-a270-517cefe4e9c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:58.500011 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b31ac575-6802-49a0-a270-517cefe4e9c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:58.500494 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b31ac575-6802-49a0-a270-517cefe4e9c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:58.501337 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b31ac575-6802-49a0-a270-517cefe4e9c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:58.501817 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b31ac575-6802-49a0-a270-517cefe4e9c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:58.531879 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2052d17a-2399-47df-a4ce-4ef4b0bf77f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:58.532857 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2052d17a-2399-47df-a4ce-4ef4b0bf77f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:58.539567 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2052d17a-2399-47df-a4ce-4ef4b0bf77f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:58.540099 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2052d17a-2399-47df-a4ce-4ef4b0bf77f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:58.540905 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2052d17a-2399-47df-a4ce-4ef4b0bf77f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:58.541339 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2052d17a-2399-47df-a4ce-4ef4b0bf77f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:58.659291 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b31ac575-6802-49a0-a270-517cefe4e9c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 28471 microversion: 2.20 time: 0.170078 Jul 22 22:20:58.660017 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 516/1052] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:58 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 28471 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:58.698912 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2052d17a-2399-47df-a4ce-4ef4b0bf77f4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 1106 microversion: 2.1 time: 0.171563 Jul 22 22:20:58.702201 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 537/1053] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:58 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 1106 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:20:59.671563 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fe5ec947-a900-49d9-aa02-9997168efef9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:59.672575 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fe5ec947-a900-49d9-aa02-9997168efef9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:59.679540 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe5ec947-a900-49d9-aa02-9997168efef9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:59.679933 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe5ec947-a900-49d9-aa02-9997168efef9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:59.680728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe5ec947-a900-49d9-aa02-9997168efef9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:59.681158 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe5ec947-a900-49d9-aa02-9997168efef9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:59.711020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f4ef10f5-95aa-481f-b239-69c2e9090d28 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:59.712041 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f4ef10f5-95aa-481f-b239-69c2e9090d28 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:20:59.718467 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f4ef10f5-95aa-481f-b239-69c2e9090d28 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:59.718910 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f4ef10f5-95aa-481f-b239-69c2e9090d28 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:59.719728 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f4ef10f5-95aa-481f-b239-69c2e9090d28 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:20:59.720160 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f4ef10f5-95aa-481f-b239-69c2e9090d28 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:20:59.829093 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fe5ec947-a900-49d9-aa02-9997168efef9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 28638 microversion: 2.20 time: 0.161442 Jul 22 22:20:59.829740 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 517/1054] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:20:59 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 28638 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:20:59.885670 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f4ef10f5-95aa-481f-b239-69c2e9090d28 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 10414 microversion: 2.1 time: 0.179032 Jul 22 22:20:59.886346 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 538/1055] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:20:59 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 10414 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:20:59.993926 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-7957a301-9c5d-4582-a298-025711b20aef req-d7258390-cd9f-43f1-8c4d-1e749f948c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42179d6a-451f-4dca-83f8-042ff823e17c", "tag": "d51d96d5-7ed6-46ea-ac2b-42c80c4d2a76"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:20:59.995509 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:20:59.995509 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:21:00.004376 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-7957a301-9c5d-4582-a298-025711b20aef req-d7258390-cd9f-43f1-8c4d-1e749f948c2f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:00.004825 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-7957a301-9c5d-4582-a298-025711b20aef req-d7258390-cd9f-43f1-8c4d-1e749f948c2f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:00.017378 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-7957a301-9c5d-4582-a298-025711b20aef req-d7258390-cd9f-43f1-8c4d-1e749f948c2f service nova] Creating event network-changed:d51d96d5-7ed6-46ea-ac2b-42c80c4d2a76 for instance 42179d6a-451f-4dca-83f8-042ff823e17c on hv-cinder-80186 Jul 22 22:21:00.022371 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-7957a301-9c5d-4582-a298-025711b20aef req-d7258390-cd9f-43f1-8c4d-1e749f948c2f service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032803 Jul 22 22:21:00.023663 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 518/1056] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:20:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:21:00.841731 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3f1b118d-ec0a-486b-b261-121ffc404d47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:00.843465 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3f1b118d-ec0a-486b-b261-121ffc404d47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:00.850192 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3f1b118d-ec0a-486b-b261-121ffc404d47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:00.851228 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3f1b118d-ec0a-486b-b261-121ffc404d47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:00.852337 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3f1b118d-ec0a-486b-b261-121ffc404d47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:00.852888 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3f1b118d-ec0a-486b-b261-121ffc404d47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:00.898635 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-408de401-fd53-4661-afe9-a97ccae70f63 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:00.899653 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-408de401-fd53-4661-afe9-a97ccae70f63 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:00.906119 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-408de401-fd53-4661-afe9-a97ccae70f63 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:00.906579 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-408de401-fd53-4661-afe9-a97ccae70f63 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:00.907487 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-408de401-fd53-4661-afe9-a97ccae70f63 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:00.907931 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-408de401-fd53-4661-afe9-a97ccae70f63 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:01.014549 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3f1b118d-ec0a-486b-b261-121ffc404d47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 28638 microversion: 2.20 time: 0.176272 Jul 22 22:21:01.015353 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 539/1057] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:00 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 28638 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:01.078849 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-408de401-fd53-4661-afe9-a97ccae70f63 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 15480 microversion: 2.1 time: 0.184899 Jul 22 22:21:01.079568 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 519/1058] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:00 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 15480 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:02.027108 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6ac86c1f-ff7f-4eec-b05d-7582f9b45228 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:02.028094 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6ac86c1f-ff7f-4eec-b05d-7582f9b45228 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:02.034494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ac86c1f-ff7f-4eec-b05d-7582f9b45228 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:02.034941 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ac86c1f-ff7f-4eec-b05d-7582f9b45228 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:02.035701 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ac86c1f-ff7f-4eec-b05d-7582f9b45228 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:02.036129 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6ac86c1f-ff7f-4eec-b05d-7582f9b45228 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:02.091163 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c6327201-cd70-4aa0-8fd2-a433a802b8f8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:02.092250 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c6327201-cd70-4aa0-8fd2-a433a802b8f8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:02.099222 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c6327201-cd70-4aa0-8fd2-a433a802b8f8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:02.099672 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c6327201-cd70-4aa0-8fd2-a433a802b8f8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:02.100476 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c6327201-cd70-4aa0-8fd2-a433a802b8f8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:02.101077 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c6327201-cd70-4aa0-8fd2-a433a802b8f8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:02.206006 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6ac86c1f-ff7f-4eec-b05d-7582f9b45228 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 28638 microversion: 2.20 time: 0.183115 Jul 22 22:21:02.206903 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 540/1059] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:02 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 28638 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:02.263402 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c6327201-cd70-4aa0-8fd2-a433a802b8f8 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 18056 microversion: 2.1 time: 0.176103 Jul 22 22:21:02.264265 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 520/1060] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:02 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 18056 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:03.218488 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d4a27675-48ec-45e0-8809-c8d82df50f54 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:03.219571 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d4a27675-48ec-45e0-8809-c8d82df50f54 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:03.226417 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d4a27675-48ec-45e0-8809-c8d82df50f54 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:03.226869 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d4a27675-48ec-45e0-8809-c8d82df50f54 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:03.227674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d4a27675-48ec-45e0-8809-c8d82df50f54 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:03.228111 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d4a27675-48ec-45e0-8809-c8d82df50f54 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:03.274896 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-eb063a84-34aa-478b-9ca5-dd5b20720978 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:03.275882 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-eb063a84-34aa-478b-9ca5-dd5b20720978 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:03.282494 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eb063a84-34aa-478b-9ca5-dd5b20720978 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:03.282967 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eb063a84-34aa-478b-9ca5-dd5b20720978 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:03.283738 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eb063a84-34aa-478b-9ca5-dd5b20720978 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:03.284172 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eb063a84-34aa-478b-9ca5-dd5b20720978 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:03.342566 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d4a27675-48ec-45e0-8809-c8d82df50f54 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 28638 microversion: 2.20 time: 0.127919 Jul 22 22:21:03.343213 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 541/1061] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:03 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 28638 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:03.443964 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-eb063a84-34aa-478b-9ca5-dd5b20720978 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 19342 microversion: 2.1 time: 0.173358 Jul 22 22:21:03.445287 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 521/1062] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:03 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 19342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:04.356984 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0c1067a3-9dee-41b5-a957-e130fe5ded62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:04.357891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0c1067a3-9dee-41b5-a957-e130fe5ded62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:04.364383 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0c1067a3-9dee-41b5-a957-e130fe5ded62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:04.364834 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0c1067a3-9dee-41b5-a957-e130fe5ded62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:04.365638 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0c1067a3-9dee-41b5-a957-e130fe5ded62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:04.366077 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0c1067a3-9dee-41b5-a957-e130fe5ded62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:04.457064 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c7f09bad-479b-4d8c-84b3-0d8ee8b8ecaa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:04.458066 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c7f09bad-479b-4d8c-84b3-0d8ee8b8ecaa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:04.465640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c7f09bad-479b-4d8c-84b3-0d8ee8b8ecaa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:04.466096 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c7f09bad-479b-4d8c-84b3-0d8ee8b8ecaa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:04.466872 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c7f09bad-479b-4d8c-84b3-0d8ee8b8ecaa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:04.467317 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c7f09bad-479b-4d8c-84b3-0d8ee8b8ecaa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:04.471982 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0c1067a3-9dee-41b5-a957-e130fe5ded62 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 28638 microversion: 2.20 time: 0.119142 Jul 22 22:21:04.476525 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 542/1063] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:04 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 28638 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:04.597259 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c7f09bad-479b-4d8c-84b3-0d8ee8b8ecaa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 21159 microversion: 2.1 time: 0.144032 Jul 22 22:21:04.597899 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 522/1064] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:04 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 21159 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:05.484180 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-23078ca1-d3d0-43f5-bf28-e0d08ecaec26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:05.485123 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-23078ca1-d3d0-43f5-bf28-e0d08ecaec26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:05.491832 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-23078ca1-d3d0-43f5-bf28-e0d08ecaec26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:05.492293 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-23078ca1-d3d0-43f5-bf28-e0d08ecaec26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:05.493087 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-23078ca1-d3d0-43f5-bf28-e0d08ecaec26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:05.493518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-23078ca1-d3d0-43f5-bf28-e0d08ecaec26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:05.610095 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4f4dd1c4-1109-4b14-94e0-345e06e7c080 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:05.611124 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4f4dd1c4-1109-4b14-94e0-345e06e7c080 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:05.618962 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f4dd1c4-1109-4b14-94e0-345e06e7c080 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:05.619418 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f4dd1c4-1109-4b14-94e0-345e06e7c080 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:05.620204 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f4dd1c4-1109-4b14-94e0-345e06e7c080 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:05.620666 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4f4dd1c4-1109-4b14-94e0-345e06e7c080 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:05.622027 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-23078ca1-d3d0-43f5-bf28-e0d08ecaec26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 29537 microversion: 2.20 time: 0.141833 Jul 22 22:21:05.625932 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 543/1065] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:05 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 29537 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:05.756260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4f4dd1c4-1109-4b14-94e0-345e06e7c080 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 22782 microversion: 2.1 time: 0.149934 Jul 22 22:21:05.756860 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 523/1066] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:05 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 22782 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:06.635296 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-736d6c94-1a79-4981-9309-3e21b4b1f186 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:06.636419 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-736d6c94-1a79-4981-9309-3e21b4b1f186 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:06.642805 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-736d6c94-1a79-4981-9309-3e21b4b1f186 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:06.643249 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-736d6c94-1a79-4981-9309-3e21b4b1f186 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:06.644034 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-736d6c94-1a79-4981-9309-3e21b4b1f186 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:06.644541 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-736d6c94-1a79-4981-9309-3e21b4b1f186 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:06.768287 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ef30fa5e-a41b-4633-b4bb-fe4b64f5d92a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:06.769303 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ef30fa5e-a41b-4633-b4bb-fe4b64f5d92a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:06.776097 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef30fa5e-a41b-4633-b4bb-fe4b64f5d92a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:06.776565 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef30fa5e-a41b-4633-b4bb-fe4b64f5d92a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:06.777044 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-736d6c94-1a79-4981-9309-3e21b4b1f186 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 30886 microversion: 2.20 time: 0.146728 Jul 22 22:21:06.777347 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef30fa5e-a41b-4633-b4bb-fe4b64f5d92a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:06.777692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 544/1067] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:06 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 30886 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:21:06.777858 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef30fa5e-a41b-4633-b4bb-fe4b64f5d92a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:06.901122 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ef30fa5e-a41b-4633-b4bb-fe4b64f5d92a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 23796 microversion: 2.1 time: 0.136604 Jul 22 22:21:06.901682 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 524/1068] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:06 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 23796 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:07.789362 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-88838d18-fb60-4888-b162-2b93ad87a2ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:07.790356 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-88838d18-fb60-4888-b162-2b93ad87a2ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:07.796800 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-88838d18-fb60-4888-b162-2b93ad87a2ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:07.797250 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-88838d18-fb60-4888-b162-2b93ad87a2ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:07.798012 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-88838d18-fb60-4888-b162-2b93ad87a2ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:07.798449 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-88838d18-fb60-4888-b162-2b93ad87a2ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:07.913326 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0acc2b7a-71c0-48ee-9ae4-d36bf22f6b33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:07.914304 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0acc2b7a-71c0-48ee-9ae4-d36bf22f6b33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:07.920903 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0acc2b7a-71c0-48ee-9ae4-d36bf22f6b33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:07.921353 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0acc2b7a-71c0-48ee-9ae4-d36bf22f6b33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:07.922106 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0acc2b7a-71c0-48ee-9ae4-d36bf22f6b33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:07.922534 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0acc2b7a-71c0-48ee-9ae4-d36bf22f6b33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:07.935801 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-88838d18-fb60-4888-b162-2b93ad87a2ef tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 32078 microversion: 2.20 time: 0.150283 Jul 22 22:21:07.936729 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 545/1069] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:07 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 32078 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:08.052470 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0acc2b7a-71c0-48ee-9ae4-d36bf22f6b33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 24937 microversion: 2.1 time: 0.143035 Jul 22 22:21:08.053057 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 525/1070] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:07 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 24937 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:08.948204 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-102805b0-dab5-49cf-8606-c573a14d1a05 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:08.949270 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-102805b0-dab5-49cf-8606-c573a14d1a05 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:08.955660 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-102805b0-dab5-49cf-8606-c573a14d1a05 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:08.956094 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-102805b0-dab5-49cf-8606-c573a14d1a05 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:08.956877 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-102805b0-dab5-49cf-8606-c573a14d1a05 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:08.957301 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-102805b0-dab5-49cf-8606-c573a14d1a05 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:09.064049 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bde44373-0b2a-4f36-b47b-b89b02105ab1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:09.065076 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bde44373-0b2a-4f36-b47b-b89b02105ab1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:09.072710 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bde44373-0b2a-4f36-b47b-b89b02105ab1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:09.073162 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bde44373-0b2a-4f36-b47b-b89b02105ab1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:09.073935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bde44373-0b2a-4f36-b47b-b89b02105ab1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:09.074391 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bde44373-0b2a-4f36-b47b-b89b02105ab1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:09.078370 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-102805b0-dab5-49cf-8606-c573a14d1a05 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 32964 microversion: 2.20 time: 0.134215 Jul 22 22:21:09.082790 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 546/1071] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:08 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 32964 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:09.190700 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bde44373-0b2a-4f36-b47b-b89b02105ab1 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 26049 microversion: 2.1 time: 0.130555 Jul 22 22:21:09.191355 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 526/1072] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:09 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 26049 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:10.091507 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a29e4e73-f192-4606-8834-69966c52c747 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:10.092546 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a29e4e73-f192-4606-8834-69966c52c747 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:10.098967 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a29e4e73-f192-4606-8834-69966c52c747 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:10.099409 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a29e4e73-f192-4606-8834-69966c52c747 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:10.100182 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a29e4e73-f192-4606-8834-69966c52c747 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:10.102451 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a29e4e73-f192-4606-8834-69966c52c747 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:10.203255 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-17d008bf-1e70-4722-823e-710e46a28baa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:10.204258 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-17d008bf-1e70-4722-823e-710e46a28baa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:10.211006 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17d008bf-1e70-4722-823e-710e46a28baa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:10.211444 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17d008bf-1e70-4722-823e-710e46a28baa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:10.212198 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17d008bf-1e70-4722-823e-710e46a28baa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:10.212820 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17d008bf-1e70-4722-823e-710e46a28baa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:10.240513 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a29e4e73-f192-4606-8834-69966c52c747 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 33456 microversion: 2.20 time: 0.152870 Jul 22 22:21:10.241803 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 547/1073] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:10 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 33456 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:10.354079 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-17d008bf-1e70-4722-823e-710e46a28baa tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 26931 microversion: 2.1 time: 0.154539 Jul 22 22:21:10.354643 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 527/1074] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:10 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 26931 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:11.253381 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ebcc9058-e8f5-44ed-98e7-994d2169b801 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:11.254366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ebcc9058-e8f5-44ed-98e7-994d2169b801 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:11.261321 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ebcc9058-e8f5-44ed-98e7-994d2169b801 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:11.261757 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ebcc9058-e8f5-44ed-98e7-994d2169b801 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:11.262511 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ebcc9058-e8f5-44ed-98e7-994d2169b801 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:11.263104 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ebcc9058-e8f5-44ed-98e7-994d2169b801 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:11.366205 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4bfaeedf-a72e-4ee0-a862-6de282b65114 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:11.367220 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4bfaeedf-a72e-4ee0-a862-6de282b65114 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:11.373711 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4bfaeedf-a72e-4ee0-a862-6de282b65114 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:11.374148 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4bfaeedf-a72e-4ee0-a862-6de282b65114 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:11.374900 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4bfaeedf-a72e-4ee0-a862-6de282b65114 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:11.375327 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4bfaeedf-a72e-4ee0-a862-6de282b65114 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:11.411665 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ebcc9058-e8f5-44ed-98e7-994d2169b801 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 33968 microversion: 2.20 time: 0.162159 Jul 22 22:21:11.412328 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 548/1075] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:11 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 33968 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:11.513279 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4bfaeedf-a72e-4ee0-a862-6de282b65114 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 27329 microversion: 2.1 time: 0.150983 Jul 22 22:21:11.513838 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 528/1076] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:11 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 27329 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:12.424434 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2038498e-0001-4cb0-b9bf-4dfd7d7e23cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:12.425384 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2038498e-0001-4cb0-b9bf-4dfd7d7e23cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:12.432088 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2038498e-0001-4cb0-b9bf-4dfd7d7e23cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:12.432580 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2038498e-0001-4cb0-b9bf-4dfd7d7e23cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:12.433376 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2038498e-0001-4cb0-b9bf-4dfd7d7e23cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:12.433816 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2038498e-0001-4cb0-b9bf-4dfd7d7e23cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:12.525720 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cc3cc37f-2c03-4d98-a000-61761f7077af tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:12.526753 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cc3cc37f-2c03-4d98-a000-61761f7077af tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:12.533492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc3cc37f-2c03-4d98-a000-61761f7077af tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:12.533944 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc3cc37f-2c03-4d98-a000-61761f7077af tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:12.534742 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc3cc37f-2c03-4d98-a000-61761f7077af tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:12.535179 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cc3cc37f-2c03-4d98-a000-61761f7077af tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:12.558504 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2038498e-0001-4cb0-b9bf-4dfd7d7e23cf tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 34783 microversion: 2.20 time: 0.138102 Jul 22 22:21:12.561344 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 549/1077] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:12 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 34783 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:12.663752 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cc3cc37f-2c03-4d98-a000-61761f7077af tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 27610 microversion: 2.1 time: 0.141975 Jul 22 22:21:12.664423 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 529/1078] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:12 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 27610 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:13.571755 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b0bd4f5f-f844-4f4e-b628-277166809c96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:13.572788 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b0bd4f5f-f844-4f4e-b628-277166809c96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:13.579338 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b0bd4f5f-f844-4f4e-b628-277166809c96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:13.579775 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b0bd4f5f-f844-4f4e-b628-277166809c96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:13.580567 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b0bd4f5f-f844-4f4e-b628-277166809c96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:13.581038 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b0bd4f5f-f844-4f4e-b628-277166809c96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:13.675874 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-66b046a7-252a-4511-afda-40c61d5c39bd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:13.676885 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-66b046a7-252a-4511-afda-40c61d5c39bd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:13.683429 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-66b046a7-252a-4511-afda-40c61d5c39bd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:13.683872 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-66b046a7-252a-4511-afda-40c61d5c39bd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:13.684822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-66b046a7-252a-4511-afda-40c61d5c39bd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:13.685257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-66b046a7-252a-4511-afda-40c61d5c39bd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:13.711511 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b0bd4f5f-f844-4f4e-b628-277166809c96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 35490 microversion: 2.20 time: 0.144417 Jul 22 22:21:13.713599 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 550/1079] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:13 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 35490 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:21:13.820169 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-66b046a7-252a-4511-afda-40c61d5c39bd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 27870 microversion: 2.1 time: 0.148093 Jul 22 22:21:13.820842 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 530/1080] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:13 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 27870 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:14.725485 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4fd53612-1fce-4f7a-b1fb-aae651751d27 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:14.726586 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4fd53612-1fce-4f7a-b1fb-aae651751d27 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:14.733001 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4fd53612-1fce-4f7a-b1fb-aae651751d27 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:14.733440 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4fd53612-1fce-4f7a-b1fb-aae651751d27 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:14.734198 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4fd53612-1fce-4f7a-b1fb-aae651751d27 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:14.734636 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4fd53612-1fce-4f7a-b1fb-aae651751d27 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:14.832217 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ffec2602-14df-4cc2-816c-7accf6cffcc4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:14.833499 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ffec2602-14df-4cc2-816c-7accf6cffcc4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:14.840642 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ffec2602-14df-4cc2-816c-7accf6cffcc4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:14.841086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ffec2602-14df-4cc2-816c-7accf6cffcc4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:14.841866 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ffec2602-14df-4cc2-816c-7accf6cffcc4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:14.842291 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ffec2602-14df-4cc2-816c-7accf6cffcc4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:14.858708 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4fd53612-1fce-4f7a-b1fb-aae651751d27 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 36477 microversion: 2.20 time: 0.137791 Jul 22 22:21:14.859598 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 551/1081] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:14 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 36477 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:14.973797 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ffec2602-14df-4cc2-816c-7accf6cffcc4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 28215 microversion: 2.1 time: 0.145377 Jul 22 22:21:14.974439 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 531/1082] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:14 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 28215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:15.871112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0baad6f2-b779-4544-b61d-d60161bbb3b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:15.872109 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0baad6f2-b779-4544-b61d-d60161bbb3b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:15.878735 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0baad6f2-b779-4544-b61d-d60161bbb3b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:15.879125 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0baad6f2-b779-4544-b61d-d60161bbb3b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:15.879886 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0baad6f2-b779-4544-b61d-d60161bbb3b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:15.880345 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0baad6f2-b779-4544-b61d-d60161bbb3b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:15.986233 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a188baa8-e840-4f1a-ab0a-ff6b93e450ab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:15.987245 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a188baa8-e840-4f1a-ab0a-ff6b93e450ab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:15.994785 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a188baa8-e840-4f1a-ab0a-ff6b93e450ab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:15.995234 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a188baa8-e840-4f1a-ab0a-ff6b93e450ab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:15.996016 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a188baa8-e840-4f1a-ab0a-ff6b93e450ab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:15.996488 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a188baa8-e840-4f1a-ab0a-ff6b93e450ab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:16.010995 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0baad6f2-b779-4544-b61d-d60161bbb3b3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 37238 microversion: 2.20 time: 0.144430 Jul 22 22:21:16.013612 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 552/1083] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:15 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 37238 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:21:16.122026 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a188baa8-e840-4f1a-ab0a-ff6b93e450ab tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 28215 microversion: 2.1 time: 0.139593 Jul 22 22:21:16.122669 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 532/1084] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:15 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 28215 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:17.024332 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-303907ff-916e-49f8-822a-8c23e8cb50e2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:17.025232 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-303907ff-916e-49f8-822a-8c23e8cb50e2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:17.031709 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-303907ff-916e-49f8-822a-8c23e8cb50e2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:17.032148 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-303907ff-916e-49f8-822a-8c23e8cb50e2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:17.032927 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-303907ff-916e-49f8-822a-8c23e8cb50e2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:17.033357 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-303907ff-916e-49f8-822a-8c23e8cb50e2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:17.135389 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4a6c6907-bdaa-4dca-8af2-266282f30d69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:17.136431 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4a6c6907-bdaa-4dca-8af2-266282f30d69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:17.142495 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4a6c6907-bdaa-4dca-8af2-266282f30d69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:17.142937 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4a6c6907-bdaa-4dca-8af2-266282f30d69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:17.143712 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4a6c6907-bdaa-4dca-8af2-266282f30d69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:17.144138 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4a6c6907-bdaa-4dca-8af2-266282f30d69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:17.152170 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-303907ff-916e-49f8-822a-8c23e8cb50e2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 37974 microversion: 2.20 time: 0.132497 Jul 22 22:21:17.156325 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 553/1085] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:17 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 37974 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:17.268965 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4a6c6907-bdaa-4dca-8af2-266282f30d69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 28247 microversion: 2.1 time: 0.138169 Jul 22 22:21:17.269907 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 533/1086] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:17 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 28247 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:18.169059 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-790caa25-ed1e-4ad4-93df-e19e5867859d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:18.170185 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-790caa25-ed1e-4ad4-93df-e19e5867859d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:18.177042 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-790caa25-ed1e-4ad4-93df-e19e5867859d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:18.177497 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-790caa25-ed1e-4ad4-93df-e19e5867859d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:18.178978 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-790caa25-ed1e-4ad4-93df-e19e5867859d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:18.179453 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-790caa25-ed1e-4ad4-93df-e19e5867859d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:18.281704 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-51f29dac-b283-45dc-8189-5efb8186553d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:18.282685 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-51f29dac-b283-45dc-8189-5efb8186553d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:18.289734 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51f29dac-b283-45dc-8189-5efb8186553d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:18.290177 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51f29dac-b283-45dc-8189-5efb8186553d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:18.290940 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51f29dac-b283-45dc-8189-5efb8186553d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:18.291374 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-51f29dac-b283-45dc-8189-5efb8186553d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:18.306941 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-790caa25-ed1e-4ad4-93df-e19e5867859d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 38186 microversion: 2.20 time: 0.142036 Jul 22 22:21:18.309535 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 554/1087] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:18 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 38186 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:21:18.420699 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-51f29dac-b283-45dc-8189-5efb8186553d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 28506 microversion: 2.1 time: 0.142694 Jul 22 22:21:18.421260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 534/1088] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:18 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 28506 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:19.319345 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5d8c2aa4-2c63-45bc-a179-9282527ee35b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:19.320347 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5d8c2aa4-2c63-45bc-a179-9282527ee35b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:19.327039 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5d8c2aa4-2c63-45bc-a179-9282527ee35b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:19.327481 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5d8c2aa4-2c63-45bc-a179-9282527ee35b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:19.328240 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5d8c2aa4-2c63-45bc-a179-9282527ee35b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:19.328698 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5d8c2aa4-2c63-45bc-a179-9282527ee35b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:19.433248 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0549b78d-e4fa-420c-8d44-8b7e431e10eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:19.434145 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0549b78d-e4fa-420c-8d44-8b7e431e10eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:19.440629 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0549b78d-e4fa-420c-8d44-8b7e431e10eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:19.441073 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0549b78d-e4fa-420c-8d44-8b7e431e10eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:19.441836 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0549b78d-e4fa-420c-8d44-8b7e431e10eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:19.442264 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0549b78d-e4fa-420c-8d44-8b7e431e10eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:19.472678 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5d8c2aa4-2c63-45bc-a179-9282527ee35b tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 38205 microversion: 2.20 time: 0.157271 Jul 22 22:21:19.473331 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 555/1089] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:19 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 38205 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:19.609771 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0549b78d-e4fa-420c-8d44-8b7e431e10eb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 28674 microversion: 2.1 time: 0.180595 Jul 22 22:21:19.610431 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 535/1090] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:19 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 28674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:20.485823 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9ff6fdd6-3a67-48be-bd83-97285d8cf6a3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:20.486726 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9ff6fdd6-3a67-48be-bd83-97285d8cf6a3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:20.493942 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9ff6fdd6-3a67-48be-bd83-97285d8cf6a3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:20.494380 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9ff6fdd6-3a67-48be-bd83-97285d8cf6a3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:20.495144 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9ff6fdd6-3a67-48be-bd83-97285d8cf6a3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:20.495575 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9ff6fdd6-3a67-48be-bd83-97285d8cf6a3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:20.621641 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6e656848-ef8a-4809-a16c-ae0f231ec7ca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:20.622639 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6e656848-ef8a-4809-a16c-ae0f231ec7ca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:20.624650 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9ff6fdd6-3a67-48be-bd83-97285d8cf6a3 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 200 len: 38327 microversion: 2.20 time: 0.142692 Jul 22 22:21:20.625303 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 556/1091] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:20 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 38327 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:20.630854 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6e656848-ef8a-4809-a16c-ae0f231ec7ca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:20.631306 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6e656848-ef8a-4809-a16c-ae0f231ec7ca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:20.632115 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6e656848-ef8a-4809-a16c-ae0f231ec7ca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:20.632580 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6e656848-ef8a-4809-a16c-ae0f231ec7ca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:20.637149 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-0494dbb3-efd3-4a11-96bd-4b6ee0586d21 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:20.637725 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-0494dbb3-efd3-4a11-96bd-4b6ee0586d21 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:20.644089 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0494dbb3-efd3-4a11-96bd-4b6ee0586d21 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:20.644571 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0494dbb3-efd3-4a11-96bd-4b6ee0586d21 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:20.645337 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0494dbb3-efd3-4a11-96bd-4b6ee0586d21 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:20.645766 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-0494dbb3-efd3-4a11-96bd-4b6ee0586d21 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:20.671107 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-0494dbb3-efd3-4a11-96bd-4b6ee0586d21 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/ips" status: 200 len: 151 microversion: 2.20 time: 0.037906 Jul 22 22:21:20.671686 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 557/1092] 10.222.0.110 () {60 vars in 1294 bytes} [Thu Jul 22 22:21:20 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:20.751083 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6e656848-ef8a-4809-a16c-ae0f231ec7ca tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 28674 microversion: 2.1 time: 0.133254 Jul 22 22:21:20.754946 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 536/1093] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:20 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 28674 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:21.762816 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-767204ba-2aac-4ead-966f-c15e37c9ca69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:21.763719 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-767204ba-2aac-4ead-966f-c15e37c9ca69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:21.769952 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-767204ba-2aac-4ead-966f-c15e37c9ca69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:21.770395 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-767204ba-2aac-4ead-966f-c15e37c9ca69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:21.771239 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-767204ba-2aac-4ead-966f-c15e37c9ca69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:21.771703 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-767204ba-2aac-4ead-966f-c15e37c9ca69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:21.874245 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-767204ba-2aac-4ead-966f-c15e37c9ca69 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 28674 microversion: 2.1 time: 0.114923 Jul 22 22:21:21.874881 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 558/1094] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:21 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 28674 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:22.886945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-77ad3943-48a1-49cf-be14-3dbd820e168f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:22.887943 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-77ad3943-48a1-49cf-be14-3dbd820e168f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:22.894558 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-77ad3943-48a1-49cf-be14-3dbd820e168f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:22.895009 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-77ad3943-48a1-49cf-be14-3dbd820e168f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:22.895809 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-77ad3943-48a1-49cf-be14-3dbd820e168f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:22.896403 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-77ad3943-48a1-49cf-be14-3dbd820e168f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:23.013146 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-77ad3943-48a1-49cf-be14-3dbd820e168f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 28674 microversion: 2.1 time: 0.130246 Jul 22 22:21:23.013946 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 537/1095] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:22 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 28674 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:23.095842 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7863a2eb-2b6f-445d-ae61-e3acad85e831 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:23.096594 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7863a2eb-2b6f-445d-ae61-e3acad85e831 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:23.103176 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7863a2eb-2b6f-445d-ae61-e3acad85e831 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:23.104126 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7863a2eb-2b6f-445d-ae61-e3acad85e831 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:23.104836 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7863a2eb-2b6f-445d-ae61-e3acad85e831 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:23.105268 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7863a2eb-2b6f-445d-ae61-e3acad85e831 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:23.129076 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-7863a2eb-2b6f-445d-ae61-e3acad85e831 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lazy-loading 'flavor' on Instance uuid 39a594cb-1699-4423-9bf3-f141ab59ad1d {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:21:23.384667 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7863a2eb-2b6f-445d-ae61-e3acad85e831 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 202 len: 0 microversion: 2.20 time: 0.292653 Jul 22 22:21:23.385291 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 559/1096] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:23 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:21:23.394033 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0e3a80c2-a1b5-41b3-8330-71b6a26cedd4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:23.394732 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0e3a80c2-a1b5-41b3-8330-71b6a26cedd4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:23.402254 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0e3a80c2-a1b5-41b3-8330-71b6a26cedd4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:23.402705 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0e3a80c2-a1b5-41b3-8330-71b6a26cedd4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:23.403480 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0e3a80c2-a1b5-41b3-8330-71b6a26cedd4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:23.403945 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0e3a80c2-a1b5-41b3-8330-71b6a26cedd4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:23.543414 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0e3a80c2-a1b5-41b3-8330-71b6a26cedd4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:23.551170 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0e3a80c2-a1b5-41b3-8330-71b6a26cedd4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:23.553259 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0e3a80c2-a1b5-41b3-8330-71b6a26cedd4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:23.554394 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0e3a80c2-a1b5-41b3-8330-71b6a26cedd4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.164585 Jul 22 22:21:23.554946 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 538/1097] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:23 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:24.027610 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e526aad1-c322-4683-824b-a4ad55a00bd7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:24.028627 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e526aad1-c322-4683-824b-a4ad55a00bd7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:24.034731 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e526aad1-c322-4683-824b-a4ad55a00bd7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:24.035318 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e526aad1-c322-4683-824b-a4ad55a00bd7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:24.036078 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e526aad1-c322-4683-824b-a4ad55a00bd7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:24.036669 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e526aad1-c322-4683-824b-a4ad55a00bd7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:24.151537 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e526aad1-c322-4683-824b-a4ad55a00bd7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 28674 microversion: 2.1 time: 0.128790 Jul 22 22:21:24.152174 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 560/1098] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:24 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 28674 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:24.574097 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-349014b4-14e7-49d0-acd3-82fb85cd90d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:24.574703 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-349014b4-14e7-49d0-acd3-82fb85cd90d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:24.581088 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-349014b4-14e7-49d0-acd3-82fb85cd90d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:24.581533 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-349014b4-14e7-49d0-acd3-82fb85cd90d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:24.582557 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-349014b4-14e7-49d0-acd3-82fb85cd90d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:24.582981 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-349014b4-14e7-49d0-acd3-82fb85cd90d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:24.718292 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-349014b4-14e7-49d0-acd3-82fb85cd90d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:24.726165 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-349014b4-14e7-49d0-acd3-82fb85cd90d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:24.727657 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-349014b4-14e7-49d0-acd3-82fb85cd90d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:24.728820 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-349014b4-14e7-49d0-acd3-82fb85cd90d1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.158447 Jul 22 22:21:24.729369 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 539/1099] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:24 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:25.164042 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b8729659-c25c-4e3d-a904-c393f91ade39 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:25.165046 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b8729659-c25c-4e3d-a904-c393f91ade39 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:25.171588 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8729659-c25c-4e3d-a904-c393f91ade39 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:25.172037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8729659-c25c-4e3d-a904-c393f91ade39 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:25.172846 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8729659-c25c-4e3d-a904-c393f91ade39 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:25.173280 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b8729659-c25c-4e3d-a904-c393f91ade39 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:25.303656 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b8729659-c25c-4e3d-a904-c393f91ade39 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 28794 microversion: 2.1 time: 0.144504 Jul 22 22:21:25.304339 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 561/1100] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:25 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 28794 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:25.747141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-17e62b32-0658-47e0-b5fa-6841c5d8e83f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:25.747852 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-17e62b32-0658-47e0-b5fa-6841c5d8e83f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:25.753645 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17e62b32-0658-47e0-b5fa-6841c5d8e83f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:25.754097 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17e62b32-0658-47e0-b5fa-6841c5d8e83f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:25.754862 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17e62b32-0658-47e0-b5fa-6841c5d8e83f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:25.756245 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17e62b32-0658-47e0-b5fa-6841c5d8e83f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:25.897790 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-17e62b32-0658-47e0-b5fa-6841c5d8e83f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:25.905805 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-17e62b32-0658-47e0-b5fa-6841c5d8e83f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:25.907317 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-17e62b32-0658-47e0-b5fa-6841c5d8e83f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:25.908493 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-17e62b32-0658-47e0-b5fa-6841c5d8e83f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.165113 Jul 22 22:21:25.909048 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 540/1101] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:25 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:26.315765 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8b03b70b-5432-4e5b-b208-086fcbef27a4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:26.316776 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8b03b70b-5432-4e5b-b208-086fcbef27a4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:26.323894 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b03b70b-5432-4e5b-b208-086fcbef27a4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:26.324513 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b03b70b-5432-4e5b-b208-086fcbef27a4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:26.325278 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b03b70b-5432-4e5b-b208-086fcbef27a4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:26.325705 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8b03b70b-5432-4e5b-b208-086fcbef27a4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:26.464808 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8b03b70b-5432-4e5b-b208-086fcbef27a4 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 30143 microversion: 2.1 time: 0.152861 Jul 22 22:21:26.465494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 562/1102] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:26 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 30143 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:26.926465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-415eca77-b166-4ad3-9789-7a8c51266596 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:26.927612 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-415eca77-b166-4ad3-9789-7a8c51266596 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:26.934020 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-415eca77-b166-4ad3-9789-7a8c51266596 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:26.934462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-415eca77-b166-4ad3-9789-7a8c51266596 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:26.935234 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-415eca77-b166-4ad3-9789-7a8c51266596 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:26.935663 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-415eca77-b166-4ad3-9789-7a8c51266596 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:27.071231 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-415eca77-b166-4ad3-9789-7a8c51266596 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:27.078990 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-415eca77-b166-4ad3-9789-7a8c51266596 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:27.080522 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-415eca77-b166-4ad3-9789-7a8c51266596 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:27.081660 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-415eca77-b166-4ad3-9789-7a8c51266596 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.158897 Jul 22 22:21:27.082468 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 541/1103] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:26 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:27.478152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-df1027b0-aaee-4af0-ad5d-434cff4c9e6f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:27.479156 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-df1027b0-aaee-4af0-ad5d-434cff4c9e6f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:27.485612 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-df1027b0-aaee-4af0-ad5d-434cff4c9e6f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:27.486055 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-df1027b0-aaee-4af0-ad5d-434cff4c9e6f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:27.486813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-df1027b0-aaee-4af0-ad5d-434cff4c9e6f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:27.487248 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-df1027b0-aaee-4af0-ad5d-434cff4c9e6f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:27.641037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-df1027b0-aaee-4af0-ad5d-434cff4c9e6f tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 31335 microversion: 2.1 time: 0.167817 Jul 22 22:21:27.641727 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 563/1104] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:27 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 31335 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:28.100832 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e2b4b2f2-49d1-48fb-9440-00f207c9087e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:28.101415 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e2b4b2f2-49d1-48fb-9440-00f207c9087e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:28.107484 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e2b4b2f2-49d1-48fb-9440-00f207c9087e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:28.108185 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e2b4b2f2-49d1-48fb-9440-00f207c9087e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:28.113564 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e2b4b2f2-49d1-48fb-9440-00f207c9087e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:28.113564 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e2b4b2f2-49d1-48fb-9440-00f207c9087e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:28.256985 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e2b4b2f2-49d1-48fb-9440-00f207c9087e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:28.265032 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e2b4b2f2-49d1-48fb-9440-00f207c9087e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:28.266539 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e2b4b2f2-49d1-48fb-9440-00f207c9087e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:28.267672 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e2b4b2f2-49d1-48fb-9440-00f207c9087e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.170691 Jul 22 22:21:28.268217 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 542/1105] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:28 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:28.653545 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a6ff4ab3-e02d-42a1-9661-8a25ad93bf01 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:28.654537 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a6ff4ab3-e02d-42a1-9661-8a25ad93bf01 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:28.661191 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a6ff4ab3-e02d-42a1-9661-8a25ad93bf01 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:28.662191 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a6ff4ab3-e02d-42a1-9661-8a25ad93bf01 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:28.663737 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a6ff4ab3-e02d-42a1-9661-8a25ad93bf01 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:28.663737 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a6ff4ab3-e02d-42a1-9661-8a25ad93bf01 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:28.826183 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a6ff4ab3-e02d-42a1-9661-8a25ad93bf01 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 32804 microversion: 2.1 time: 0.176412 Jul 22 22:21:28.827091 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 564/1106] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:28 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 32804 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:29.286005 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8f77f707-81a9-495f-99cf-e8d084b0d484 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:29.286836 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8f77f707-81a9-495f-99cf-e8d084b0d484 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:29.293027 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8f77f707-81a9-495f-99cf-e8d084b0d484 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:29.293479 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8f77f707-81a9-495f-99cf-e8d084b0d484 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:29.294265 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8f77f707-81a9-495f-99cf-e8d084b0d484 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:29.294701 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8f77f707-81a9-495f-99cf-e8d084b0d484 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:29.432329 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8f77f707-81a9-495f-99cf-e8d084b0d484 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:29.440064 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8f77f707-81a9-495f-99cf-e8d084b0d484 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:29.441596 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8f77f707-81a9-495f-99cf-e8d084b0d484 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:29.442947 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8f77f707-81a9-495f-99cf-e8d084b0d484 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.160511 Jul 22 22:21:29.443659 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 543/1107] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:29 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:29.839058 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e2160d7b-e0b3-4f3e-a11d-7e0242ab46cd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:29.840051 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e2160d7b-e0b3-4f3e-a11d-7e0242ab46cd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:29.846621 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e2160d7b-e0b3-4f3e-a11d-7e0242ab46cd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:29.847077 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e2160d7b-e0b3-4f3e-a11d-7e0242ab46cd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:29.847848 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e2160d7b-e0b3-4f3e-a11d-7e0242ab46cd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:29.848299 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e2160d7b-e0b3-4f3e-a11d-7e0242ab46cd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:29.975522 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e2160d7b-e0b3-4f3e-a11d-7e0242ab46cd tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 33765 microversion: 2.1 time: 0.140274 Jul 22 22:21:29.976498 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 565/1108] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:29 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 33765 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:30.462261 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3e024801-4176-4630-84c5-5d381b58e3a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:30.462849 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3e024801-4176-4630-84c5-5d381b58e3a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:30.468821 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e024801-4176-4630-84c5-5d381b58e3a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:30.469275 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e024801-4176-4630-84c5-5d381b58e3a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:30.470049 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e024801-4176-4630-84c5-5d381b58e3a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:30.470487 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3e024801-4176-4630-84c5-5d381b58e3a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:30.605970 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3e024801-4176-4630-84c5-5d381b58e3a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:30.613735 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3e024801-4176-4630-84c5-5d381b58e3a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:30.615588 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3e024801-4176-4630-84c5-5d381b58e3a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:30.616764 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3e024801-4176-4630-84c5-5d381b58e3a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.159047 Jul 22 22:21:30.617327 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 544/1109] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:30 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:30.987551 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-eb6dd5f5-d543-4906-ae4c-113d0b02d579 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:30.988606 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-eb6dd5f5-d543-4906-ae4c-113d0b02d579 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:30.996768 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb6dd5f5-d543-4906-ae4c-113d0b02d579 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:30.997218 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb6dd5f5-d543-4906-ae4c-113d0b02d579 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:30.998012 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb6dd5f5-d543-4906-ae4c-113d0b02d579 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:30.998429 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-eb6dd5f5-d543-4906-ae4c-113d0b02d579 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:31.132821 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-eb6dd5f5-d543-4906-ae4c-113d0b02d579 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 34458 microversion: 2.1 time: 0.149145 Jul 22 22:21:31.133720 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 566/1110] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:30 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 34458 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:31.635138 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0a8ed5a7-2013-454b-b411-c2be621098e5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:31.635732 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0a8ed5a7-2013-454b-b411-c2be621098e5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:31.642152 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a8ed5a7-2013-454b-b411-c2be621098e5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:31.642595 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a8ed5a7-2013-454b-b411-c2be621098e5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:31.643352 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a8ed5a7-2013-454b-b411-c2be621098e5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:31.643778 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a8ed5a7-2013-454b-b411-c2be621098e5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:31.783835 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0a8ed5a7-2013-454b-b411-c2be621098e5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:31.792156 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0a8ed5a7-2013-454b-b411-c2be621098e5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:31.793806 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0a8ed5a7-2013-454b-b411-c2be621098e5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:31.794925 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0a8ed5a7-2013-454b-b411-c2be621098e5 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.163551 Jul 22 22:21:31.795482 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 545/1111] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:31 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:32.145768 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-35371297-abb9-405f-93ae-0062ce4b7a7d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:32.146570 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-35371297-abb9-405f-93ae-0062ce4b7a7d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:32.153145 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35371297-abb9-405f-93ae-0062ce4b7a7d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:32.153593 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35371297-abb9-405f-93ae-0062ce4b7a7d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:32.154421 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35371297-abb9-405f-93ae-0062ce4b7a7d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:32.154847 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-35371297-abb9-405f-93ae-0062ce4b7a7d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:32.290470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-35371297-abb9-405f-93ae-0062ce4b7a7d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 35168 microversion: 2.1 time: 0.148803 Jul 22 22:21:32.291064 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 567/1112] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:32 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 35168 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:32.813593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b2cc3782-c9da-473d-a8f5-d5388c59bfeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:32.814195 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b2cc3782-c9da-473d-a8f5-d5388c59bfeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:32.820257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b2cc3782-c9da-473d-a8f5-d5388c59bfeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:32.820742 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b2cc3782-c9da-473d-a8f5-d5388c59bfeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:32.821493 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b2cc3782-c9da-473d-a8f5-d5388c59bfeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:32.821924 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b2cc3782-c9da-473d-a8f5-d5388c59bfeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:32.960457 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b2cc3782-c9da-473d-a8f5-d5388c59bfeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:32.968229 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b2cc3782-c9da-473d-a8f5-d5388c59bfeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:32.969754 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b2cc3782-c9da-473d-a8f5-d5388c59bfeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:32.970894 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b2cc3782-c9da-473d-a8f5-d5388c59bfeb tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.161018 Jul 22 22:21:32.971456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 546/1113] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:32 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:33.302964 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-620efe70-9ed6-4f4e-bbf6-75ed045dd806 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:33.303979 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-620efe70-9ed6-4f4e-bbf6-75ed045dd806 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:33.310398 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-620efe70-9ed6-4f4e-bbf6-75ed045dd806 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:33.310835 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-620efe70-9ed6-4f4e-bbf6-75ed045dd806 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:33.311752 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-620efe70-9ed6-4f4e-bbf6-75ed045dd806 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:33.312177 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-620efe70-9ed6-4f4e-bbf6-75ed045dd806 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:33.441962 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-620efe70-9ed6-4f4e-bbf6-75ed045dd806 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 36057 microversion: 2.1 time: 0.143049 Jul 22 22:21:33.443183 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 568/1114] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:33 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 36057 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:33.990634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c28f78a1-79a1-4079-ba24-ea539c0cbcb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:33.991248 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c28f78a1-79a1-4079-ba24-ea539c0cbcb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:33.997293 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c28f78a1-79a1-4079-ba24-ea539c0cbcb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:33.997747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c28f78a1-79a1-4079-ba24-ea539c0cbcb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:33.998517 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c28f78a1-79a1-4079-ba24-ea539c0cbcb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:33.998951 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c28f78a1-79a1-4079-ba24-ea539c0cbcb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:34.139884 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c28f78a1-79a1-4079-ba24-ea539c0cbcb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:34.147926 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c28f78a1-79a1-4079-ba24-ea539c0cbcb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:34.149431 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-c28f78a1-79a1-4079-ba24-ea539c0cbcb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:34.150560 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c28f78a1-79a1-4079-ba24-ea539c0cbcb0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.164342 Jul 22 22:21:34.151108 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 547/1115] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:33 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:34.454700 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9aba8f85-5a22-444e-ae4e-1e5bc1ef3776 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:34.455686 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9aba8f85-5a22-444e-ae4e-1e5bc1ef3776 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:34.462676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9aba8f85-5a22-444e-ae4e-1e5bc1ef3776 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:34.463119 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9aba8f85-5a22-444e-ae4e-1e5bc1ef3776 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:34.463891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9aba8f85-5a22-444e-ae4e-1e5bc1ef3776 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:34.464340 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9aba8f85-5a22-444e-ae4e-1e5bc1ef3776 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:34.579768 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9aba8f85-5a22-444e-ae4e-1e5bc1ef3776 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 37004 microversion: 2.1 time: 0.128978 Jul 22 22:21:34.580433 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 569/1116] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:34 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 37004 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:35.168466 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fe4f5adb-56c7-44e1-be17-c4bc5d947e2a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:35.168987 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fe4f5adb-56c7-44e1-be17-c4bc5d947e2a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:35.174956 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe4f5adb-56c7-44e1-be17-c4bc5d947e2a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:35.175410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe4f5adb-56c7-44e1-be17-c4bc5d947e2a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:35.176178 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe4f5adb-56c7-44e1-be17-c4bc5d947e2a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:35.176648 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fe4f5adb-56c7-44e1-be17-c4bc5d947e2a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:35.313698 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fe4f5adb-56c7-44e1-be17-c4bc5d947e2a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:35.322151 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fe4f5adb-56c7-44e1-be17-c4bc5d947e2a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:35.323640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fe4f5adb-56c7-44e1-be17-c4bc5d947e2a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:35.324889 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fe4f5adb-56c7-44e1-be17-c4bc5d947e2a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.160336 Jul 22 22:21:35.325435 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 548/1117] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:35 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:35.592031 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3786301d-9a20-4358-b67b-8debd01c3d6b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:35.593043 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3786301d-9a20-4358-b67b-8debd01c3d6b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:35.599974 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3786301d-9a20-4358-b67b-8debd01c3d6b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:35.600458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3786301d-9a20-4358-b67b-8debd01c3d6b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:35.601244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3786301d-9a20-4358-b67b-8debd01c3d6b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:35.601674 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3786301d-9a20-4358-b67b-8debd01c3d6b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:35.731984 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3786301d-9a20-4358-b67b-8debd01c3d6b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 38106 microversion: 2.1 time: 0.143795 Jul 22 22:21:35.732665 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 570/1118] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:35 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 38106 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:36.343358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fb951472-27fb-4bdf-85a7-37034178b32c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:36.343966 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fb951472-27fb-4bdf-85a7-37034178b32c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:36.350300 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fb951472-27fb-4bdf-85a7-37034178b32c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:36.350754 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fb951472-27fb-4bdf-85a7-37034178b32c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:36.351522 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fb951472-27fb-4bdf-85a7-37034178b32c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:36.352050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fb951472-27fb-4bdf-85a7-37034178b32c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:36.486107 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fb951472-27fb-4bdf-85a7-37034178b32c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:36.495087 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fb951472-27fb-4bdf-85a7-37034178b32c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:36.496646 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fb951472-27fb-4bdf-85a7-37034178b32c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:36.497803 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fb951472-27fb-4bdf-85a7-37034178b32c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.158186 Jul 22 22:21:36.498358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 549/1119] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:36 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:36.745634 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4362b8d1-2dc4-4d49-969c-8a77ffca5c0d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:36.746528 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4362b8d1-2dc4-4d49-969c-8a77ffca5c0d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:36.753007 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4362b8d1-2dc4-4d49-969c-8a77ffca5c0d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:36.753439 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4362b8d1-2dc4-4d49-969c-8a77ffca5c0d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:36.754186 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4362b8d1-2dc4-4d49-969c-8a77ffca5c0d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:36.754611 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4362b8d1-2dc4-4d49-969c-8a77ffca5c0d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:36.863611 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4362b8d1-2dc4-4d49-969c-8a77ffca5c0d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 38197 microversion: 2.1 time: 0.122937 Jul 22 22:21:36.864851 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 571/1120] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:36 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 38197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:37.516482 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bc4b7802-4dcb-479e-9cc0-375b8f218d8d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:37.517026 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bc4b7802-4dcb-479e-9cc0-375b8f218d8d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:37.522978 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bc4b7802-4dcb-479e-9cc0-375b8f218d8d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:37.523425 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bc4b7802-4dcb-479e-9cc0-375b8f218d8d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:37.524187 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bc4b7802-4dcb-479e-9cc0-375b8f218d8d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:37.524644 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bc4b7802-4dcb-479e-9cc0-375b8f218d8d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:37.663286 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bc4b7802-4dcb-479e-9cc0-375b8f218d8d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:37.671410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bc4b7802-4dcb-479e-9cc0-375b8f218d8d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:37.673037 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bc4b7802-4dcb-479e-9cc0-375b8f218d8d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:37.674174 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bc4b7802-4dcb-479e-9cc0-375b8f218d8d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.161527 Jul 22 22:21:37.674739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 550/1121] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:37 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:37.876543 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-313ddfc0-2119-4f98-90e5-19eccb14431b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:37.877556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-313ddfc0-2119-4f98-90e5-19eccb14431b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:37.884551 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-313ddfc0-2119-4f98-90e5-19eccb14431b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:37.884996 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-313ddfc0-2119-4f98-90e5-19eccb14431b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:37.885771 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-313ddfc0-2119-4f98-90e5-19eccb14431b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:37.886205 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-313ddfc0-2119-4f98-90e5-19eccb14431b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:37.977896 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-313ddfc0-2119-4f98-90e5-19eccb14431b tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 38197 microversion: 2.1 time: 0.105223 Jul 22 22:21:37.978827 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 572/1122] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:37 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 38197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:38.692249 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-848e281a-cb7f-4c07-8ac9-ba7ce1451b26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:38.692902 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-848e281a-cb7f-4c07-8ac9-ba7ce1451b26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:38.699026 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-848e281a-cb7f-4c07-8ac9-ba7ce1451b26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:38.699477 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-848e281a-cb7f-4c07-8ac9-ba7ce1451b26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:38.700308 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-848e281a-cb7f-4c07-8ac9-ba7ce1451b26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:38.700741 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-848e281a-cb7f-4c07-8ac9-ba7ce1451b26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:38.836162 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-848e281a-cb7f-4c07-8ac9-ba7ce1451b26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:38.843983 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-848e281a-cb7f-4c07-8ac9-ba7ce1451b26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:38.845484 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-848e281a-cb7f-4c07-8ac9-ba7ce1451b26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:38.846614 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-848e281a-cb7f-4c07-8ac9-ba7ce1451b26 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.158123 Jul 22 22:21:38.847167 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 551/1123] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:38 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:38.991406 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bfc16265-6fd8-4fdf-8eaf-ebbd0ac86bfe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:38.992573 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-bfc16265-6fd8-4fdf-8eaf-ebbd0ac86bfe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:38.999044 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfc16265-6fd8-4fdf-8eaf-ebbd0ac86bfe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:38.999492 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfc16265-6fd8-4fdf-8eaf-ebbd0ac86bfe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:39.000260 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfc16265-6fd8-4fdf-8eaf-ebbd0ac86bfe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:39.000719 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bfc16265-6fd8-4fdf-8eaf-ebbd0ac86bfe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:39.121856 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-bfc16265-6fd8-4fdf-8eaf-ebbd0ac86bfe tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action" status: 200 len: 38328 microversion: 2.1 time: 0.135351 Jul 22 22:21:39.122520 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 573/1124] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:21:38 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/action => generated 38328 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 22 22:21:39.132970 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3ad3831a-78bf-4e66-a6ce-07907dd0e2d6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:39.133459 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3ad3831a-78bf-4e66-a6ce-07907dd0e2d6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:39.139544 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3ad3831a-78bf-4e66-a6ce-07907dd0e2d6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:39.140000 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3ad3831a-78bf-4e66-a6ce-07907dd0e2d6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:39.140803 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3ad3831a-78bf-4e66-a6ce-07907dd0e2d6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:39.141232 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3ad3831a-78bf-4e66-a6ce-07907dd0e2d6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:39.166621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3ad3831a-78bf-4e66-a6ce-07907dd0e2d6 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/ips" status: 200 len: 145 microversion: 2.1 time: 0.038105 Jul 22 22:21:39.167195 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 552/1125] 10.222.0.110 () {58 vars in 1253 bytes} [Thu Jul 22 22:21:39 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:21:39.866909 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-825e99d7-a01c-4743-b969-edad14f0c1c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:39.867585 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-825e99d7-a01c-4743-b969-edad14f0c1c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:39.873955 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-825e99d7-a01c-4743-b969-edad14f0c1c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:39.874398 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-825e99d7-a01c-4743-b969-edad14f0c1c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:39.875152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-825e99d7-a01c-4743-b969-edad14f0c1c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:39.875575 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-825e99d7-a01c-4743-b969-edad14f0c1c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:40.016585 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-825e99d7-a01c-4743-b969-edad14f0c1c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:40.025016 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-825e99d7-a01c-4743-b969-edad14f0c1c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:40.026524 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-825e99d7-a01c-4743-b969-edad14f0c1c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:40.027662 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-825e99d7-a01c-4743-b969-edad14f0c1c1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1747 microversion: 2.20 time: 0.165516 Jul 22 22:21:40.028260 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 574/1126] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:39 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1747 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:40.481993 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-25d98ecb-a3e9-4546-8b7d-80928247d855 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d0824c2-5a97-49f4-b866-d6164fc2f798"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:40.483096 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-25d98ecb-a3e9-4546-8b7d-80928247d855 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:40.489364 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-25d98ecb-a3e9-4546-8b7d-80928247d855 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:40.489805 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-25d98ecb-a3e9-4546-8b7d-80928247d855 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:40.491329 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-25d98ecb-a3e9-4546-8b7d-80928247d855 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:40.491761 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-25d98ecb-a3e9-4546-8b7d-80928247d855 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:40.758009 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-25d98ecb-a3e9-4546-8b7d-80928247d855 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279601 Jul 22 22:21:40.758841 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 553/1127] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:21:40 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:21:41.045838 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-aed36bde-9d86-4a48-9b44-7cf29e2fd0dd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:41.046418 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-aed36bde-9d86-4a48-9b44-7cf29e2fd0dd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:41.052611 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aed36bde-9d86-4a48-9b44-7cf29e2fd0dd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:41.053060 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aed36bde-9d86-4a48-9b44-7cf29e2fd0dd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:41.054540 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aed36bde-9d86-4a48-9b44-7cf29e2fd0dd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:41.054968 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aed36bde-9d86-4a48-9b44-7cf29e2fd0dd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:41.191333 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-aed36bde-9d86-4a48-9b44-7cf29e2fd0dd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:41.199642 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-aed36bde-9d86-4a48-9b44-7cf29e2fd0dd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:41.201636 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-aed36bde-9d86-4a48-9b44-7cf29e2fd0dd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:41.202482 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-aed36bde-9d86-4a48-9b44-7cf29e2fd0dd tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1747 microversion: 2.20 time: 0.160335 Jul 22 22:21:41.203032 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 575/1128] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:41 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1747 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:42.221730 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f11bce58-aac7-4128-8358-5d4d2f061f9f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:42.223435 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f11bce58-aac7-4128-8358-5d4d2f061f9f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:42.231454 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f11bce58-aac7-4128-8358-5d4d2f061f9f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:42.232047 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f11bce58-aac7-4128-8358-5d4d2f061f9f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:42.233116 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f11bce58-aac7-4128-8358-5d4d2f061f9f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:42.233662 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f11bce58-aac7-4128-8358-5d4d2f061f9f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:42.406383 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f11bce58-aac7-4128-8358-5d4d2f061f9f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:42.415387 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f11bce58-aac7-4128-8358-5d4d2f061f9f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:42.417255 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f11bce58-aac7-4128-8358-5d4d2f061f9f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:42.418572 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f11bce58-aac7-4128-8358-5d4d2f061f9f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1742 microversion: 2.20 time: 0.200950 Jul 22 22:21:42.419340 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 554/1129] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:42 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1742 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:21:43.399424 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-2725d9d3-d80b-4252-9541-9f567b0bc657 req-a935fd5c-c815-4876-8d26-a9db1c5f582b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a594cb-1699-4423-9bf3-f141ab59ad1d", "name": "network-vif-plugged", "status": "completed", "tag": "faef284b-3bc0-45b4-9175-e5021628b786"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:43.401953 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:21:43.401953 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:21:43.411479 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-2725d9d3-d80b-4252-9541-9f567b0bc657 req-a935fd5c-c815-4876-8d26-a9db1c5f582b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:43.412163 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-2725d9d3-d80b-4252-9541-9f567b0bc657 req-a935fd5c-c815-4876-8d26-a9db1c5f582b service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:43.437673 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0c0d005b-5e4c-48c6-b002-6289f8921c91 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:43.439268 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0c0d005b-5e4c-48c6-b002-6289f8921c91 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:43.447151 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-2725d9d3-d80b-4252-9541-9f567b0bc657 req-a935fd5c-c815-4876-8d26-a9db1c5f582b service nova] Creating event network-vif-plugged:faef284b-3bc0-45b4-9175-e5021628b786 for instance 39a594cb-1699-4423-9bf3-f141ab59ad1d on hv-cinder-80186 Jul 22 22:21:43.450474 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0c0d005b-5e4c-48c6-b002-6289f8921c91 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:43.451297 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0c0d005b-5e4c-48c6-b002-6289f8921c91 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:43.453715 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0c0d005b-5e4c-48c6-b002-6289f8921c91 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:43.454425 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0c0d005b-5e4c-48c6-b002-6289f8921c91 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:43.463449 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-2725d9d3-d80b-4252-9541-9f567b0bc657 req-a935fd5c-c815-4876-8d26-a9db1c5f582b service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069264 Jul 22 22:21:43.464761 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 576/1130] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:21:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:21:43.627472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0c0d005b-5e4c-48c6-b002-6289f8921c91 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:43.637007 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0c0d005b-5e4c-48c6-b002-6289f8921c91 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:43.638856 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0c0d005b-5e4c-48c6-b002-6289f8921c91 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:43.640112 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0c0d005b-5e4c-48c6-b002-6289f8921c91 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1742 microversion: 2.20 time: 0.206737 Jul 22 22:21:43.640905 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 555/1131] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:43 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1742 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:44.659754 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d378f617-702b-413d-8a6f-1716113c42a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:44.660476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d378f617-702b-413d-8a6f-1716113c42a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:44.666924 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d378f617-702b-413d-8a6f-1716113c42a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:44.667557 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d378f617-702b-413d-8a6f-1716113c42a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:44.668544 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d378f617-702b-413d-8a6f-1716113c42a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:44.668978 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d378f617-702b-413d-8a6f-1716113c42a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:44.844101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d378f617-702b-413d-8a6f-1716113c42a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:44.855950 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d378f617-702b-413d-8a6f-1716113c42a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:44.857606 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d378f617-702b-413d-8a6f-1716113c42a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:44.859114 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d378f617-702b-413d-8a6f-1716113c42a2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1742 microversion: 2.20 time: 0.203492 Jul 22 22:21:44.859671 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 577/1132] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:44 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1742 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:45.881368 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1878ad92-fa5c-4864-bf3b-a8a17edd3b95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:45.887312 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1878ad92-fa5c-4864-bf3b-a8a17edd3b95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:45.897316 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1878ad92-fa5c-4864-bf3b-a8a17edd3b95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:45.897847 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1878ad92-fa5c-4864-bf3b-a8a17edd3b95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:45.898818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1878ad92-fa5c-4864-bf3b-a8a17edd3b95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:45.899314 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1878ad92-fa5c-4864-bf3b-a8a17edd3b95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:46.095731 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1878ad92-fa5c-4864-bf3b-a8a17edd3b95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:46.105267 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1878ad92-fa5c-4864-bf3b-a8a17edd3b95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:46.107518 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1878ad92-fa5c-4864-bf3b-a8a17edd3b95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:46.108879 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1878ad92-fa5c-4864-bf3b-a8a17edd3b95 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1742 microversion: 2.20 time: 0.233250 Jul 22 22:21:46.109872 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 556/1133] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:45 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1742 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:47.128732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a5d064be-d5c7-47e8-93f0-9730e3d4f27c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:47.129994 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a5d064be-d5c7-47e8-93f0-9730e3d4f27c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:47.139222 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a5d064be-d5c7-47e8-93f0-9730e3d4f27c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:47.139986 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a5d064be-d5c7-47e8-93f0-9730e3d4f27c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:47.141262 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a5d064be-d5c7-47e8-93f0-9730e3d4f27c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:47.142402 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a5d064be-d5c7-47e8-93f0-9730e3d4f27c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:47.357936 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a5d064be-d5c7-47e8-93f0-9730e3d4f27c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:47.367861 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a5d064be-d5c7-47e8-93f0-9730e3d4f27c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:47.369624 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a5d064be-d5c7-47e8-93f0-9730e3d4f27c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:47.370932 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a5d064be-d5c7-47e8-93f0-9730e3d4f27c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1742 microversion: 2.20 time: 0.245954 Jul 22 22:21:47.372348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 578/1134] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:47 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1742 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:21:48.390993 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-99c866d4-4717-4367-b83a-5d423d5be487 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:48.394301 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-99c866d4-4717-4367-b83a-5d423d5be487 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:48.401728 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-48effb0e-22a5-4fe3-9fd2-d6a58c60fa43 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:48.404171 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-48effb0e-22a5-4fe3-9fd2-d6a58c60fa43 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:48.405115 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-99c866d4-4717-4367-b83a-5d423d5be487 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:48.406097 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-99c866d4-4717-4367-b83a-5d423d5be487 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:48.409177 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-99c866d4-4717-4367-b83a-5d423d5be487 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:48.414397 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-99c866d4-4717-4367-b83a-5d423d5be487 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:48.415937 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-48effb0e-22a5-4fe3-9fd2-d6a58c60fa43 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:48.416957 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-48effb0e-22a5-4fe3-9fd2-d6a58c60fa43 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:48.420902 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-48effb0e-22a5-4fe3-9fd2-d6a58c60fa43 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:48.421151 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-48effb0e-22a5-4fe3-9fd2-d6a58c60fa43 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:48.479096 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-48effb0e-22a5-4fe3-9fd2-d6a58c60fa43 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084646 Jul 22 22:21:48.480096 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 579/1135] 10.222.0.110 () {58 vars in 1307 bytes} [Thu Jul 22 22:21:48 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:21:48.498100 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1b8a43f0-7668-4d71-9b5b-e1b83a76edda tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:48.498940 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1b8a43f0-7668-4d71-9b5b-e1b83a76edda tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:48.505890 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1b8a43f0-7668-4d71-9b5b-e1b83a76edda tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:48.506687 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1b8a43f0-7668-4d71-9b5b-e1b83a76edda tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:48.508574 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1b8a43f0-7668-4d71-9b5b-e1b83a76edda tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:48.509255 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1b8a43f0-7668-4d71-9b5b-e1b83a76edda tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:48.558412 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1b8a43f0-7668-4d71-9b5b-e1b83a76edda tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments/9d0824c2-5a97-49f4-b866-d6164fc2f798" status: 200 len: 194 microversion: 2.1 time: 0.066447 Jul 22 22:21:48.563958 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 580/1136] 10.222.0.110 () {58 vars in 1418 bytes} [Thu Jul 22 22:21:48 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments/9d0824c2-5a97-49f4-b866-d6164fc2f798 => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:21:48.604666 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-99c866d4-4717-4367-b83a-5d423d5be487 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:48.616212 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-99c866d4-4717-4367-b83a-5d423d5be487 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:48.619530 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-99c866d4-4717-4367-b83a-5d423d5be487 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:48.621075 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-99c866d4-4717-4367-b83a-5d423d5be487 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1742 microversion: 2.20 time: 0.234018 Jul 22 22:21:48.622231 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 557/1137] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:48 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1742 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:49.641297 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bae7f18f-525e-425d-acf3-beb26c95986c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:49.642450 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-bae7f18f-525e-425d-acf3-beb26c95986c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:49.649838 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bae7f18f-525e-425d-acf3-beb26c95986c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:49.650513 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bae7f18f-525e-425d-acf3-beb26c95986c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:49.651479 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bae7f18f-525e-425d-acf3-beb26c95986c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:49.652119 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bae7f18f-525e-425d-acf3-beb26c95986c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:49.808043 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-bae7f18f-525e-425d-acf3-beb26c95986c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:49.816323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-bae7f18f-525e-425d-acf3-beb26c95986c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:49.817837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-bae7f18f-525e-425d-acf3-beb26c95986c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:49.818994 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-bae7f18f-525e-425d-acf3-beb26c95986c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1742 microversion: 2.20 time: 0.182096 Jul 22 22:21:49.820908 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 581/1138] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:49 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1742 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:49.946138 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9bb9202e-ae0a-43ea-bca2-938bb2473cb7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ef855af-ffb3-449e-b56c-5246547da645"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:49.947456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9bb9202e-ae0a-43ea-bca2-938bb2473cb7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:49.953571 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9bb9202e-ae0a-43ea-bca2-938bb2473cb7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:49.954022 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9bb9202e-ae0a-43ea-bca2-938bb2473cb7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:49.954811 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9bb9202e-ae0a-43ea-bca2-938bb2473cb7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:49.955492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9bb9202e-ae0a-43ea-bca2-938bb2473cb7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:50.243519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9bb9202e-ae0a-43ea-bca2-938bb2473cb7 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302758 Jul 22 22:21:50.244333 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 558/1139] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:21:49 2021] POST /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:21:50.839413 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b5030ba2-2d69-4562-8641-2522fc44bd8f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:50.840746 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b5030ba2-2d69-4562-8641-2522fc44bd8f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:50.847799 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b5030ba2-2d69-4562-8641-2522fc44bd8f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:50.848305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b5030ba2-2d69-4562-8641-2522fc44bd8f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:50.849062 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b5030ba2-2d69-4562-8641-2522fc44bd8f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:50.849679 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b5030ba2-2d69-4562-8641-2522fc44bd8f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:51.015839 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b5030ba2-2d69-4562-8641-2522fc44bd8f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:51.025598 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b5030ba2-2d69-4562-8641-2522fc44bd8f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:51.027750 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b5030ba2-2d69-4562-8641-2522fc44bd8f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:51.029321 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b5030ba2-2d69-4562-8641-2522fc44bd8f tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1742 microversion: 2.20 time: 0.194322 Jul 22 22:21:51.030340 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 582/1140] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:50 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1742 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:52.050822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ff2840c7-a4aa-48e7-a778-08bd12f1ce4d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:52.051509 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ff2840c7-a4aa-48e7-a778-08bd12f1ce4d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:52.059206 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ff2840c7-a4aa-48e7-a778-08bd12f1ce4d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:52.059646 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ff2840c7-a4aa-48e7-a778-08bd12f1ce4d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:52.060463 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ff2840c7-a4aa-48e7-a778-08bd12f1ce4d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:52.060895 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ff2840c7-a4aa-48e7-a778-08bd12f1ce4d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:52.219418 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ff2840c7-a4aa-48e7-a778-08bd12f1ce4d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:52.227576 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ff2840c7-a4aa-48e7-a778-08bd12f1ce4d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:52.229088 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ff2840c7-a4aa-48e7-a778-08bd12f1ce4d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:52.230280 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ff2840c7-a4aa-48e7-a778-08bd12f1ce4d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1742 microversion: 2.20 time: 0.184116 Jul 22 22:21:52.230837 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 559/1141] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:52 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1742 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:53.248484 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b1a9ac68-c799-4cd0-bc4e-717750376a06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:53.249124 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b1a9ac68-c799-4cd0-bc4e-717750376a06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:53.255134 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1a9ac68-c799-4cd0-bc4e-717750376a06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:53.255580 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1a9ac68-c799-4cd0-bc4e-717750376a06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:53.256385 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1a9ac68-c799-4cd0-bc4e-717750376a06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:53.256856 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b1a9ac68-c799-4cd0-bc4e-717750376a06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:53.481397 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b1a9ac68-c799-4cd0-bc4e-717750376a06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:53.489426 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b1a9ac68-c799-4cd0-bc4e-717750376a06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:53.491676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b1a9ac68-c799-4cd0-bc4e-717750376a06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:53.493148 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b1a9ac68-c799-4cd0-bc4e-717750376a06 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1724 microversion: 2.20 time: 0.248471 Jul 22 22:21:53.494304 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 583/1142] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:53 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:54.513430 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6090733c-c39f-4113-9010-6bc4fb4a1b22 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:54.514067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-6090733c-c39f-4113-9010-6bc4fb4a1b22 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:54.521067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6090733c-c39f-4113-9010-6bc4fb4a1b22 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:54.521516 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6090733c-c39f-4113-9010-6bc4fb4a1b22 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:54.522938 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6090733c-c39f-4113-9010-6bc4fb4a1b22 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:54.523465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-6090733c-c39f-4113-9010-6bc4fb4a1b22 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:54.676152 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6090733c-c39f-4113-9010-6bc4fb4a1b22 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:54.685351 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6090733c-c39f-4113-9010-6bc4fb4a1b22 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:54.686848 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-6090733c-c39f-4113-9010-6bc4fb4a1b22 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:54.687990 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6090733c-c39f-4113-9010-6bc4fb4a1b22 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1724 microversion: 2.20 time: 0.178520 Jul 22 22:21:54.688582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 560/1143] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:54 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:55.707021 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d24704d4-16b9-4142-9f02-d7ec1788ae96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:55.707645 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d24704d4-16b9-4142-9f02-d7ec1788ae96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:55.714265 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d24704d4-16b9-4142-9f02-d7ec1788ae96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:55.714702 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d24704d4-16b9-4142-9f02-d7ec1788ae96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:55.715459 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d24704d4-16b9-4142-9f02-d7ec1788ae96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:55.715879 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d24704d4-16b9-4142-9f02-d7ec1788ae96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:55.854766 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d24704d4-16b9-4142-9f02-d7ec1788ae96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:55.863461 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d24704d4-16b9-4142-9f02-d7ec1788ae96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:55.866255 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d24704d4-16b9-4142-9f02-d7ec1788ae96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:55.867545 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d24704d4-16b9-4142-9f02-d7ec1788ae96 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1724 microversion: 2.20 time: 0.164465 Jul 22 22:21:55.868113 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 584/1144] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:55 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:56.887559 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-adfed03b-2ce2-475d-90eb-89ae81ca8331 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:56.888202 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-adfed03b-2ce2-475d-90eb-89ae81ca8331 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:56.894144 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-adfed03b-2ce2-475d-90eb-89ae81ca8331 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:56.894595 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-adfed03b-2ce2-475d-90eb-89ae81ca8331 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:56.895366 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-adfed03b-2ce2-475d-90eb-89ae81ca8331 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:56.895801 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-adfed03b-2ce2-475d-90eb-89ae81ca8331 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:57.032043 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-adfed03b-2ce2-475d-90eb-89ae81ca8331 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:57.040222 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-adfed03b-2ce2-475d-90eb-89ae81ca8331 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:57.041741 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-adfed03b-2ce2-475d-90eb-89ae81ca8331 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:57.042882 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-adfed03b-2ce2-475d-90eb-89ae81ca8331 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1727 microversion: 2.20 time: 0.159135 Jul 22 22:21:57.043438 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 561/1145] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:56 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:21:57.061123 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9faeb6ca-40ce-4b02-9bfb-e99635bd129e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f2622eb-27f1-4e7c-b863-0e8b467178df"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:57.062149 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9faeb6ca-40ce-4b02-9bfb-e99635bd129e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:57.068457 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9faeb6ca-40ce-4b02-9bfb-e99635bd129e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:57.068902 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9faeb6ca-40ce-4b02-9bfb-e99635bd129e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:57.070331 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9faeb6ca-40ce-4b02-9bfb-e99635bd129e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:57.070753 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9faeb6ca-40ce-4b02-9bfb-e99635bd129e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:57.358898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9faeb6ca-40ce-4b02-9bfb-e99635bd129e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301464 Jul 22 22:21:57.359509 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 585/1146] 10.222.0.110 () {62 vars in 1369 bytes} [Thu Jul 22 22:21:57 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 22 22:21:57.406176 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-dada902e-6ccc-492f-8c4c-b9d464e268dd req-2a9597b5-0344-4fd2-b5d8-c2f0c7d5d0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a594cb-1699-4423-9bf3-f141ab59ad1d", "name": "network-vif-unplugged", "status": "completed", "tag": "faef284b-3bc0-45b4-9175-e5021628b786"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:57.407779 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:21:57.407779 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:21:57.424739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-dada902e-6ccc-492f-8c4c-b9d464e268dd req-2a9597b5-0344-4fd2-b5d8-c2f0c7d5d0e6 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:57.425187 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-dada902e-6ccc-492f-8c4c-b9d464e268dd req-2a9597b5-0344-4fd2-b5d8-c2f0c7d5d0e6 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:57.430668 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a0eeb90d-78ea-440a-bf49-ba7b04030d30 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:57.431211 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a0eeb90d-78ea-440a-bf49-ba7b04030d30 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:57.438370 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.compute.server_external_events [req-dada902e-6ccc-492f-8c4c-b9d464e268dd req-2a9597b5-0344-4fd2-b5d8-c2f0c7d5d0e6 service nova] Unable to find a host for instance 39a594cb-1699-4423-9bf3-f141ab59ad1d. Dropping event network-vif-unplugged {{(pid=107498) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jul 22 22:21:57.438581 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0eeb90d-78ea-440a-bf49-ba7b04030d30 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:57.439123 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0eeb90d-78ea-440a-bf49-ba7b04030d30 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:57.439266 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-dada902e-6ccc-492f-8c4c-b9d464e268dd req-2a9597b5-0344-4fd2-b5d8-c2f0c7d5d0e6 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037007 Jul 22 22:21:57.440000 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 562/1147] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:21:57 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 22 22:21:57.440117 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0eeb90d-78ea-440a-bf49-ba7b04030d30 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:57.440428 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0eeb90d-78ea-440a-bf49-ba7b04030d30 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:57.706252 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a0eeb90d-78ea-440a-bf49-ba7b04030d30 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "DELETE /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/os-volume_attachments/4f2622eb-27f1-4e7c-b863-0e8b467178df" status: 202 len: 0 microversion: 2.20 time: 0.280464 Jul 22 22:21:57.710406 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 586/1148] 10.222.0.110 () {60 vars in 1462 bytes} [Thu Jul 22 22:21:57 2021] DELETE /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/os-volume_attachments/4f2622eb-27f1-4e7c-b863-0e8b467178df => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:21:57.768517 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7da5c458-8987-491d-ad3a-e6ee4793517e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:21:57.769222 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7da5c458-8987-491d-ad3a-e6ee4793517e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:57.771237 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9e4b43e6-32d4-4963-8c62-30fcbdceeaa2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:57.772950 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9e4b43e6-32d4-4963-8c62-30fcbdceeaa2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:57.776242 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7da5c458-8987-491d-ad3a-e6ee4793517e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:57.776889 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7da5c458-8987-491d-ad3a-e6ee4793517e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:57.777790 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7da5c458-8987-491d-ad3a-e6ee4793517e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:57.778358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7da5c458-8987-491d-ad3a-e6ee4793517e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:57.778858 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9e4b43e6-32d4-4963-8c62-30fcbdceeaa2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:57.779305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9e4b43e6-32d4-4963-8c62-30fcbdceeaa2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:57.780138 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9e4b43e6-32d4-4963-8c62-30fcbdceeaa2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:57.780772 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9e4b43e6-32d4-4963-8c62-30fcbdceeaa2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:57.812374 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9e4b43e6-32d4-4963-8c62-30fcbdceeaa2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045146 Jul 22 22:21:57.812951 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 587/1149] 10.222.0.110 () {58 vars in 1307 bytes} [Thu Jul 22 22:21:57 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:21:57.863768 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7da5c458-8987-491d-ad3a-e6ee4793517e tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action" status: 202 len: 0 microversion: 2.20 time: 0.099204 Jul 22 22:21:57.864620 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 563/1150] 10.222.0.110 () {62 vars in 1324 bytes} [Thu Jul 22 22:21:57 2021] POST /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 22 22:21:57.872906 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3768e9ba-133c-4763-8b55-15e55f0ab4f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:57.873599 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3768e9ba-133c-4763-8b55-15e55f0ab4f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:57.879882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3768e9ba-133c-4763-8b55-15e55f0ab4f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:57.880458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3768e9ba-133c-4763-8b55-15e55f0ab4f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:57.881229 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3768e9ba-133c-4763-8b55-15e55f0ab4f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:57.881757 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3768e9ba-133c-4763-8b55-15e55f0ab4f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:58.073720 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3768e9ba-133c-4763-8b55-15e55f0ab4f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:58.076895 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-394ce260-69c4-4fdf-af11-51d9e3ddcb33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:58.077416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-394ce260-69c4-4fdf-af11-51d9e3ddcb33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:58.084189 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-394ce260-69c4-4fdf-af11-51d9e3ddcb33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:58.085353 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-394ce260-69c4-4fdf-af11-51d9e3ddcb33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:58.086874 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-394ce260-69c4-4fdf-af11-51d9e3ddcb33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:58.087688 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-394ce260-69c4-4fdf-af11-51d9e3ddcb33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:58.092181 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3768e9ba-133c-4763-8b55-15e55f0ab4f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:58.094484 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3768e9ba-133c-4763-8b55-15e55f0ab4f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:58.096822 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3768e9ba-133c-4763-8b55-15e55f0ab4f1 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1675 microversion: 2.20 time: 0.227285 Jul 22 22:21:58.108316 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 588/1151] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:57 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:21:58.120903 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-394ce260-69c4-4fdf-af11-51d9e3ddcb33 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments/9d0824c2-5a97-49f4-b866-d6164fc2f798" status: 200 len: 194 microversion: 2.1 time: 0.047852 Jul 22 22:21:58.121525 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 564/1152] 10.222.0.110 () {58 vars in 1418 bytes} [Thu Jul 22 22:21:58 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments/9d0824c2-5a97-49f4-b866-d6164fc2f798 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:21:58.135660 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ad82c6d5-9e3b-4288-9242-1b7f6473288e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:58.136162 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ad82c6d5-9e3b-4288-9242-1b7f6473288e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:58.143307 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ad82c6d5-9e3b-4288-9242-1b7f6473288e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:58.143758 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ad82c6d5-9e3b-4288-9242-1b7f6473288e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:58.144757 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ad82c6d5-9e3b-4288-9242-1b7f6473288e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:58.145357 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ad82c6d5-9e3b-4288-9242-1b7f6473288e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:58.257277 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-ad82c6d5-9e3b-4288-9242-1b7f6473288e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lazy-loading 'services' on Instance uuid ba8f4f51-e0f7-44c6-9502-719ce8f4e606 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:21:58.334296 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ad82c6d5-9e3b-4288-9242-1b7f6473288e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "DELETE /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments/9d0824c2-5a97-49f4-b866-d6164fc2f798" status: 202 len: 0 microversion: 2.1 time: 0.204153 Jul 22 22:21:58.335506 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 589/1153] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:21:58 2021] DELETE /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments/9d0824c2-5a97-49f4-b866-d6164fc2f798 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:21:59.123062 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ce3a757c-f61f-4649-ad9c-58ce57fb84b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:21:59.123749 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ce3a757c-f61f-4649-ad9c-58ce57fb84b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:21:59.130018 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce3a757c-f61f-4649-ad9c-58ce57fb84b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:59.130461 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce3a757c-f61f-4649-ad9c-58ce57fb84b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:59.131218 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce3a757c-f61f-4649-ad9c-58ce57fb84b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:21:59.132259 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ce3a757c-f61f-4649-ad9c-58ce57fb84b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:21:59.271123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ce3a757c-f61f-4649-ad9c-58ce57fb84b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:59.278992 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ce3a757c-f61f-4649-ad9c-58ce57fb84b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:59.280508 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ce3a757c-f61f-4649-ad9c-58ce57fb84b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:21:59.281640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ce3a757c-f61f-4649-ad9c-58ce57fb84b2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.162896 Jul 22 22:21:59.282184 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 565/1154] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:21:59 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:00.301389 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-73cb59a1-504f-4a03-8897-f63de7949aff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:00.302218 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-73cb59a1-504f-4a03-8897-f63de7949aff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:00.308836 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-73cb59a1-504f-4a03-8897-f63de7949aff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:00.309281 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-73cb59a1-504f-4a03-8897-f63de7949aff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:00.310055 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-73cb59a1-504f-4a03-8897-f63de7949aff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:00.310484 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-73cb59a1-504f-4a03-8897-f63de7949aff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:00.452517 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-73cb59a1-504f-4a03-8897-f63de7949aff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:00.461918 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-73cb59a1-504f-4a03-8897-f63de7949aff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:00.463462 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-73cb59a1-504f-4a03-8897-f63de7949aff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:00.464967 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-73cb59a1-504f-4a03-8897-f63de7949aff tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.167641 Jul 22 22:22:00.465631 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 590/1155] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:00 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:00.523601 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d222e47e-f7db-4e91-93aa-27ea96be0de0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:00.524230 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d222e47e-f7db-4e91-93aa-27ea96be0de0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:00.530118 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d222e47e-f7db-4e91-93aa-27ea96be0de0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:00.530562 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d222e47e-f7db-4e91-93aa-27ea96be0de0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:00.531319 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d222e47e-f7db-4e91-93aa-27ea96be0de0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:00.531750 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d222e47e-f7db-4e91-93aa-27ea96be0de0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:00.563494 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d222e47e-f7db-4e91-93aa-27ea96be0de0 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments/5ef855af-ffb3-449e-b56c-5246547da645" status: 200 len: 194 microversion: 2.1 time: 0.043525 Jul 22 22:22:00.564128 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 566/1156] 10.222.0.110 () {58 vars in 1418 bytes} [Thu Jul 22 22:22:00 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments/5ef855af-ffb3-449e-b56c-5246547da645 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:00.575020 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c12cee9b-542a-4d2b-ad54-9dc00bc53111 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:00.575867 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c12cee9b-542a-4d2b-ad54-9dc00bc53111 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:00.582777 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c12cee9b-542a-4d2b-ad54-9dc00bc53111 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:00.583298 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c12cee9b-542a-4d2b-ad54-9dc00bc53111 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:00.584147 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c12cee9b-542a-4d2b-ad54-9dc00bc53111 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:00.585484 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c12cee9b-542a-4d2b-ad54-9dc00bc53111 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:00.699430 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-c12cee9b-542a-4d2b-ad54-9dc00bc53111 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lazy-loading 'services' on Instance uuid ba8f4f51-e0f7-44c6-9502-719ce8f4e606 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:22:00.797491 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c12cee9b-542a-4d2b-ad54-9dc00bc53111 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "DELETE /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments/5ef855af-ffb3-449e-b56c-5246547da645" status: 202 len: 0 microversion: 2.1 time: 0.225941 Jul 22 22:22:00.798405 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 591/1157] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:22:00 2021] DELETE /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606/os-volume_attachments/5ef855af-ffb3-449e-b56c-5246547da645 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:22:01.483038 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f0586758-920e-45f1-a736-2b5913a0c4b0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:01.483645 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f0586758-920e-45f1-a736-2b5913a0c4b0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:01.490018 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f0586758-920e-45f1-a736-2b5913a0c4b0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:01.490547 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f0586758-920e-45f1-a736-2b5913a0c4b0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:01.491263 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f0586758-920e-45f1-a736-2b5913a0c4b0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:01.491702 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-f0586758-920e-45f1-a736-2b5913a0c4b0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:01.648901 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f0586758-920e-45f1-a736-2b5913a0c4b0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:01.658265 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f0586758-920e-45f1-a736-2b5913a0c4b0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:01.659739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f0586758-920e-45f1-a736-2b5913a0c4b0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:01.661088 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f0586758-920e-45f1-a736-2b5913a0c4b0 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.181894 Jul 22 22:22:01.661759 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 567/1158] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:01 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:02.680850 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f8f2ea71-c905-4c78-b900-de01cc0f0385 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:02.681712 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f8f2ea71-c905-4c78-b900-de01cc0f0385 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:02.688329 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f8f2ea71-c905-4c78-b900-de01cc0f0385 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:02.688785 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f8f2ea71-c905-4c78-b900-de01cc0f0385 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:02.689594 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f8f2ea71-c905-4c78-b900-de01cc0f0385 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:02.690029 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f8f2ea71-c905-4c78-b900-de01cc0f0385 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:02.843213 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f8f2ea71-c905-4c78-b900-de01cc0f0385 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:02.852095 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f8f2ea71-c905-4c78-b900-de01cc0f0385 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:02.853612 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f8f2ea71-c905-4c78-b900-de01cc0f0385 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:02.854748 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f8f2ea71-c905-4c78-b900-de01cc0f0385 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.178263 Jul 22 22:22:02.855321 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 592/1159] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:02 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:03.873721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cf46d1e1-02cd-4153-94a5-9681149a5dc7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:03.874482 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-cf46d1e1-02cd-4153-94a5-9681149a5dc7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:03.882999 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cf46d1e1-02cd-4153-94a5-9681149a5dc7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:03.883421 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cf46d1e1-02cd-4153-94a5-9681149a5dc7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:03.884479 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cf46d1e1-02cd-4153-94a5-9681149a5dc7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:03.884922 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-cf46d1e1-02cd-4153-94a5-9681149a5dc7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:04.070718 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cf46d1e1-02cd-4153-94a5-9681149a5dc7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:04.079906 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cf46d1e1-02cd-4153-94a5-9681149a5dc7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:04.081441 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-cf46d1e1-02cd-4153-94a5-9681149a5dc7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:04.082632 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cf46d1e1-02cd-4153-94a5-9681149a5dc7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.212987 Jul 22 22:22:04.083411 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 568/1160] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:03 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:05.106590 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-22543b34-b250-4f6b-bf2c-e2739a63b002 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:05.107798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-22543b34-b250-4f6b-bf2c-e2739a63b002 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:05.119892 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22543b34-b250-4f6b-bf2c-e2739a63b002 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:05.120363 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22543b34-b250-4f6b-bf2c-e2739a63b002 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:05.121141 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22543b34-b250-4f6b-bf2c-e2739a63b002 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:05.121560 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22543b34-b250-4f6b-bf2c-e2739a63b002 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:05.272212 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-22543b34-b250-4f6b-bf2c-e2739a63b002 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:05.280740 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-22543b34-b250-4f6b-bf2c-e2739a63b002 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:05.282251 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-22543b34-b250-4f6b-bf2c-e2739a63b002 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:05.283393 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-22543b34-b250-4f6b-bf2c-e2739a63b002 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.183905 Jul 22 22:22:05.283949 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 593/1161] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:05 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:06.303462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-62a9320a-d72a-4313-bbc2-7713aa9d05f8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:06.304422 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-62a9320a-d72a-4313-bbc2-7713aa9d05f8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:06.311101 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-62a9320a-d72a-4313-bbc2-7713aa9d05f8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:06.311547 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-62a9320a-d72a-4313-bbc2-7713aa9d05f8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:06.312346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-62a9320a-d72a-4313-bbc2-7713aa9d05f8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:06.312784 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-62a9320a-d72a-4313-bbc2-7713aa9d05f8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:06.462818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-62a9320a-d72a-4313-bbc2-7713aa9d05f8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:06.471011 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-62a9320a-d72a-4313-bbc2-7713aa9d05f8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:06.472631 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-62a9320a-d72a-4313-bbc2-7713aa9d05f8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:06.474107 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-62a9320a-d72a-4313-bbc2-7713aa9d05f8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.175374 Jul 22 22:22:06.475477 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 569/1162] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:06 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:07.493578 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9904979f-640e-4d19-9684-5982be2410a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:07.494213 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9904979f-640e-4d19-9684-5982be2410a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:07.499977 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9904979f-640e-4d19-9684-5982be2410a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:07.500537 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9904979f-640e-4d19-9684-5982be2410a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:07.501608 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9904979f-640e-4d19-9684-5982be2410a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:07.502125 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9904979f-640e-4d19-9684-5982be2410a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:07.649832 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9904979f-640e-4d19-9684-5982be2410a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:07.658307 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9904979f-640e-4d19-9684-5982be2410a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:07.659801 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9904979f-640e-4d19-9684-5982be2410a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:07.661110 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9904979f-640e-4d19-9684-5982be2410a9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.172122 Jul 22 22:22:07.661663 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 594/1163] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:07 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:22:08.683255 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d9cdd5fa-be28-4182-ad89-0b1c04179c66 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:08.684249 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d9cdd5fa-be28-4182-ad89-0b1c04179c66 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:08.692161 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d9cdd5fa-be28-4182-ad89-0b1c04179c66 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:08.692807 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d9cdd5fa-be28-4182-ad89-0b1c04179c66 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:08.694280 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d9cdd5fa-be28-4182-ad89-0b1c04179c66 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:08.694876 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d9cdd5fa-be28-4182-ad89-0b1c04179c66 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:08.849450 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d9cdd5fa-be28-4182-ad89-0b1c04179c66 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:08.860954 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d9cdd5fa-be28-4182-ad89-0b1c04179c66 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:08.862452 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d9cdd5fa-be28-4182-ad89-0b1c04179c66 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:08.863599 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d9cdd5fa-be28-4182-ad89-0b1c04179c66 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.186226 Jul 22 22:22:08.864181 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 570/1164] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:08 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:09.883593 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5a2765fd-ba43-407f-ad96-3d7a6ed42358 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:09.884471 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5a2765fd-ba43-407f-ad96-3d7a6ed42358 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:09.890324 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a2765fd-ba43-407f-ad96-3d7a6ed42358 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:09.890763 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a2765fd-ba43-407f-ad96-3d7a6ed42358 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:09.891539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a2765fd-ba43-407f-ad96-3d7a6ed42358 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:09.891973 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a2765fd-ba43-407f-ad96-3d7a6ed42358 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:10.048090 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5a2765fd-ba43-407f-ad96-3d7a6ed42358 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:10.056434 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5a2765fd-ba43-407f-ad96-3d7a6ed42358 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:10.057938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5a2765fd-ba43-407f-ad96-3d7a6ed42358 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:10.059079 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5a2765fd-ba43-407f-ad96-3d7a6ed42358 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.179809 Jul 22 22:22:10.059634 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 595/1165] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:09 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:11.077804 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-eaa31efb-5ff8-4a21-8800-7dd984c9b0c2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:11.079122 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-eaa31efb-5ff8-4a21-8800-7dd984c9b0c2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:11.086734 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eaa31efb-5ff8-4a21-8800-7dd984c9b0c2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:11.087282 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eaa31efb-5ff8-4a21-8800-7dd984c9b0c2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:11.088141 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eaa31efb-5ff8-4a21-8800-7dd984c9b0c2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:11.088687 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-eaa31efb-5ff8-4a21-8800-7dd984c9b0c2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:11.238277 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-eaa31efb-5ff8-4a21-8800-7dd984c9b0c2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:11.247401 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-eaa31efb-5ff8-4a21-8800-7dd984c9b0c2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:11.248948 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-eaa31efb-5ff8-4a21-8800-7dd984c9b0c2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:11.250122 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-eaa31efb-5ff8-4a21-8800-7dd984c9b0c2 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.176079 Jul 22 22:22:11.250698 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 571/1166] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:11 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:12.269518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2c7b56fb-273f-4cd0-a77e-8b57ac5cf8b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:12.270108 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2c7b56fb-273f-4cd0-a77e-8b57ac5cf8b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:12.277707 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2c7b56fb-273f-4cd0-a77e-8b57ac5cf8b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:12.278377 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2c7b56fb-273f-4cd0-a77e-8b57ac5cf8b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:12.279390 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2c7b56fb-273f-4cd0-a77e-8b57ac5cf8b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:12.279883 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2c7b56fb-273f-4cd0-a77e-8b57ac5cf8b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:12.426874 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2c7b56fb-273f-4cd0-a77e-8b57ac5cf8b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:12.435770 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2c7b56fb-273f-4cd0-a77e-8b57ac5cf8b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:12.437337 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2c7b56fb-273f-4cd0-a77e-8b57ac5cf8b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:12.438486 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2c7b56fb-273f-4cd0-a77e-8b57ac5cf8b8 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.172832 Jul 22 22:22:12.439042 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 596/1167] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:12 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:13.456157 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a7a7f984-d1d7-49e5-9381-9636a839592c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:13.456798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a7a7f984-d1d7-49e5-9381-9636a839592c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:13.463400 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a7a7f984-d1d7-49e5-9381-9636a839592c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:13.463844 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a7a7f984-d1d7-49e5-9381-9636a839592c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:13.464635 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a7a7f984-d1d7-49e5-9381-9636a839592c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:13.465065 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a7a7f984-d1d7-49e5-9381-9636a839592c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:13.613086 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a7a7f984-d1d7-49e5-9381-9636a839592c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:13.621960 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a7a7f984-d1d7-49e5-9381-9636a839592c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:13.623466 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a7a7f984-d1d7-49e5-9381-9636a839592c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:13.624643 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a7a7f984-d1d7-49e5-9381-9636a839592c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.172578 Jul 22 22:22:13.625202 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 572/1168] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:13 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:14.642819 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2670d1d2-ee1f-4446-aaf6-939f11f9a94a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:14.643427 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2670d1d2-ee1f-4446-aaf6-939f11f9a94a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:14.650444 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2670d1d2-ee1f-4446-aaf6-939f11f9a94a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:14.650886 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2670d1d2-ee1f-4446-aaf6-939f11f9a94a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:14.651658 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2670d1d2-ee1f-4446-aaf6-939f11f9a94a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:14.652160 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2670d1d2-ee1f-4446-aaf6-939f11f9a94a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:14.826813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2670d1d2-ee1f-4446-aaf6-939f11f9a94a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:14.836335 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2670d1d2-ee1f-4446-aaf6-939f11f9a94a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:14.837825 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2670d1d2-ee1f-4446-aaf6-939f11f9a94a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:14.841146 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2670d1d2-ee1f-4446-aaf6-939f11f9a94a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.201982 Jul 22 22:22:14.841738 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 597/1169] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:14 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:14.905803 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-808c253b-81f1-4712-9a47-15e1645df51e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:14.906333 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-808c253b-81f1-4712-9a47-15e1645df51e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:14.912205 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-808c253b-81f1-4712-9a47-15e1645df51e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:14.912677 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-808c253b-81f1-4712-9a47-15e1645df51e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:14.913438 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-808c253b-81f1-4712-9a47-15e1645df51e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:14.913863 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-808c253b-81f1-4712-9a47-15e1645df51e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:14.938132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-808c253b-81f1-4712-9a47-15e1645df51e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:22:15.023625 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-808c253b-81f1-4712-9a47-15e1645df51e tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "DELETE /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 204 len: 0 microversion: 2.1 time: 0.121274 Jul 22 22:22:15.024221 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 573/1170] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:22:14 2021] DELETE /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:22:15.033610 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-64a9258c-1af6-4abf-97e9-c8461ccd9223 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:15.034317 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-64a9258c-1af6-4abf-97e9-c8461ccd9223 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:15.041344 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-64a9258c-1af6-4abf-97e9-c8461ccd9223 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:15.041794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-64a9258c-1af6-4abf-97e9-c8461ccd9223 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:15.042560 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-64a9258c-1af6-4abf-97e9-c8461ccd9223 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:15.042995 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-64a9258c-1af6-4abf-97e9-c8461ccd9223 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:15.187381 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-64a9258c-1af6-4abf-97e9-c8461ccd9223 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:15.194836 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-64a9258c-1af6-4abf-97e9-c8461ccd9223 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1677 microversion: 2.1 time: 0.165234 Jul 22 22:22:15.195395 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 598/1171] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:22:15 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:22:15.859770 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8ab5b3f4-302a-4a30-81d8-3ea6a769964a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:15.860542 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8ab5b3f4-302a-4a30-81d8-3ea6a769964a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:15.869184 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8ab5b3f4-302a-4a30-81d8-3ea6a769964a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:15.869793 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8ab5b3f4-302a-4a30-81d8-3ea6a769964a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:15.871014 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8ab5b3f4-302a-4a30-81d8-3ea6a769964a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:15.871527 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8ab5b3f4-302a-4a30-81d8-3ea6a769964a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:16.036741 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8ab5b3f4-302a-4a30-81d8-3ea6a769964a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:16.045479 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8ab5b3f4-302a-4a30-81d8-3ea6a769964a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:16.046970 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8ab5b3f4-302a-4a30-81d8-3ea6a769964a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:16.048120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8ab5b3f4-302a-4a30-81d8-3ea6a769964a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.192465 Jul 22 22:22:16.048720 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 574/1172] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:15 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:16.213244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-888ba10c-2b87-483c-b5a5-9cd1312ad70a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:16.213891 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-888ba10c-2b87-483c-b5a5-9cd1312ad70a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:16.219736 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-888ba10c-2b87-483c-b5a5-9cd1312ad70a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:16.220167 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-888ba10c-2b87-483c-b5a5-9cd1312ad70a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:16.220972 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-888ba10c-2b87-483c-b5a5-9cd1312ad70a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:16.221399 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-888ba10c-2b87-483c-b5a5-9cd1312ad70a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:16.374168 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-888ba10c-2b87-483c-b5a5-9cd1312ad70a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:16.382377 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-888ba10c-2b87-483c-b5a5-9cd1312ad70a tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1677 microversion: 2.1 time: 0.172893 Jul 22 22:22:16.382955 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 599/1173] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:22:16 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:22:17.074792 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7320791b-87e0-4ef9-bdc0-b2a509f570c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:17.075735 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7320791b-87e0-4ef9-bdc0-b2a509f570c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:17.091528 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7320791b-87e0-4ef9-bdc0-b2a509f570c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:17.093178 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7320791b-87e0-4ef9-bdc0-b2a509f570c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:17.096120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7320791b-87e0-4ef9-bdc0-b2a509f570c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:17.096713 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7320791b-87e0-4ef9-bdc0-b2a509f570c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:17.269584 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7320791b-87e0-4ef9-bdc0-b2a509f570c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:17.278374 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7320791b-87e0-4ef9-bdc0-b2a509f570c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:17.279865 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7320791b-87e0-4ef9-bdc0-b2a509f570c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:17.281250 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7320791b-87e0-4ef9-bdc0-b2a509f570c9 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.216135 Jul 22 22:22:17.281825 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 575/1174] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:17 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:17.400168 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1d60ae06-b317-4812-a09f-eda5c8b9de06 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:17.400845 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1d60ae06-b317-4812-a09f-eda5c8b9de06 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:17.406617 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d60ae06-b317-4812-a09f-eda5c8b9de06 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:17.407061 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d60ae06-b317-4812-a09f-eda5c8b9de06 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:17.407836 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d60ae06-b317-4812-a09f-eda5c8b9de06 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:17.408292 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1d60ae06-b317-4812-a09f-eda5c8b9de06 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:17.561841 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-38c764ee-594b-4036-b78f-623a9f39f731 req-dc07a733-b10b-470d-bb3a-d5d23c92ffeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a594cb-1699-4423-9bf3-f141ab59ad1d", "name": "network-vif-plugged", "status": "completed", "tag": "faef284b-3bc0-45b4-9175-e5021628b786"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:22:17.564324 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:22:17.564324 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:22:17.573960 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-38c764ee-594b-4036-b78f-623a9f39f731 req-dc07a733-b10b-470d-bb3a-d5d23c92ffeb service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:17.574432 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-38c764ee-594b-4036-b78f-623a9f39f731 req-dc07a733-b10b-470d-bb3a-d5d23c92ffeb service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:17.588102 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-38c764ee-594b-4036-b78f-623a9f39f731 req-dc07a733-b10b-470d-bb3a-d5d23c92ffeb service nova] Creating event network-vif-plugged:faef284b-3bc0-45b4-9175-e5021628b786 for instance 39a594cb-1699-4423-9bf3-f141ab59ad1d on hv-cinder-80186 Jul 22 22:22:17.593599 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-38c764ee-594b-4036-b78f-623a9f39f731 req-dc07a733-b10b-470d-bb3a-d5d23c92ffeb service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035917 Jul 22 22:22:17.594491 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 576/1175] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:22:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:17.611359 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1d60ae06-b317-4812-a09f-eda5c8b9de06 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:17.619700 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1d60ae06-b317-4812-a09f-eda5c8b9de06 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1677 microversion: 2.1 time: 0.223258 Jul 22 22:22:17.620303 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 600/1176] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:22:17 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1677 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:22:18.299667 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-94f38a6d-9f1e-47e2-aa50-ba26543cb613 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:18.300483 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-94f38a6d-9f1e-47e2-aa50-ba26543cb613 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:18.309043 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-94f38a6d-9f1e-47e2-aa50-ba26543cb613 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:18.309597 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-94f38a6d-9f1e-47e2-aa50-ba26543cb613 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:18.310447 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-94f38a6d-9f1e-47e2-aa50-ba26543cb613 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:18.310887 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-94f38a6d-9f1e-47e2-aa50-ba26543cb613 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:18.464058 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-94f38a6d-9f1e-47e2-aa50-ba26543cb613 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:18.473478 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-94f38a6d-9f1e-47e2-aa50-ba26543cb613 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:18.476197 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-94f38a6d-9f1e-47e2-aa50-ba26543cb613 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:18.477912 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-94f38a6d-9f1e-47e2-aa50-ba26543cb613 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.182505 Jul 22 22:22:18.484897 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 577/1177] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:18 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:18.541702 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-ae66e3dd-a470-4b78-85a4-82a1176d6588 req-4095fc57-5ec6-4fd9-a4dd-ee235a0f70ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8f4f51-e0f7-44c6-9502-719ce8f4e606", "name": "network-vif-deleted", "tag": "245b2585-5883-4ee1-ac31-1b72b9c0513b"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:22:18.543253 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:22:18.543253 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:22:18.551093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-ae66e3dd-a470-4b78-85a4-82a1176d6588 req-4095fc57-5ec6-4fd9-a4dd-ee235a0f70ab service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:18.551533 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-ae66e3dd-a470-4b78-85a4-82a1176d6588 req-4095fc57-5ec6-4fd9-a4dd-ee235a0f70ab service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:18.565010 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-ae66e3dd-a470-4b78-85a4-82a1176d6588 req-4095fc57-5ec6-4fd9-a4dd-ee235a0f70ab service nova] Creating event network-vif-deleted:245b2585-5883-4ee1-ac31-1b72b9c0513b for instance ba8f4f51-e0f7-44c6-9502-719ce8f4e606 on hv-cinder-80186 Jul 22 22:22:18.572252 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-ae66e3dd-a470-4b78-85a4-82a1176d6588 req-4095fc57-5ec6-4fd9-a4dd-ee235a0f70ab service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033386 Jul 22 22:22:18.572252 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 601/1178] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:22:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:22:18.637442 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d4d6f948-fae2-4101-8580-5105949899fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:18.638146 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d4d6f948-fae2-4101-8580-5105949899fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:18.645246 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4d6f948-fae2-4101-8580-5105949899fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:18.645967 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4d6f948-fae2-4101-8580-5105949899fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:18.646848 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4d6f948-fae2-4101-8580-5105949899fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:18.647398 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d4d6f948-fae2-4101-8580-5105949899fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:18.727577 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d4d6f948-fae2-4101-8580-5105949899fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1d770b6425649559463a5d37c3f3a3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93164c7b18524c7f9483aa0383349cb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:18.737339 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d4d6f948-fae2-4101-8580-5105949899fb tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 200 len: 1326 microversion: 2.1 time: 0.103745 Jul 22 22:22:18.738114 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 578/1179] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:22:18 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 1326 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:22:19.496626 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-048518a1-51b0-4e7d-81b7-81359ab5264d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:19.497336 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-048518a1-51b0-4e7d-81b7-81359ab5264d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:19.507800 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-048518a1-51b0-4e7d-81b7-81359ab5264d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:19.508561 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-048518a1-51b0-4e7d-81b7-81359ab5264d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:19.509560 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-048518a1-51b0-4e7d-81b7-81359ab5264d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:19.509995 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-048518a1-51b0-4e7d-81b7-81359ab5264d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:19.695016 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-048518a1-51b0-4e7d-81b7-81359ab5264d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:19.704825 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-048518a1-51b0-4e7d-81b7-81359ab5264d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:19.707413 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-048518a1-51b0-4e7d-81b7-81359ab5264d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:19.708977 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-048518a1-51b0-4e7d-81b7-81359ab5264d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1733 microversion: 2.20 time: 0.216590 Jul 22 22:22:19.709949 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 602/1180] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:19 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1733 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:19.757210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-88731310-c8bf-456f-9775-8fda821d9f8d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:19.758184 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-88731310-c8bf-456f-9775-8fda821d9f8d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:19.765277 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-88731310-c8bf-456f-9775-8fda821d9f8d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:19.765992 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-88731310-c8bf-456f-9775-8fda821d9f8d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:19.766937 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-88731310-c8bf-456f-9775-8fda821d9f8d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:19.767539 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-88731310-c8bf-456f-9775-8fda821d9f8d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:19.785425 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-88731310-c8bf-456f-9775-8fda821d9f8d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] HTTP exception thrown: Instance ba8f4f51-e0f7-44c6-9502-719ce8f4e606 could not be found. Jul 22 22:22:19.786441 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-88731310-c8bf-456f-9775-8fda821d9f8d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Returning 404 to user: Instance ba8f4f51-e0f7-44c6-9502-719ce8f4e606 could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:22:19.787876 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-88731310-c8bf-456f-9775-8fda821d9f8d tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 404 len: 111 microversion: 2.1 time: 0.036685 Jul 22 22:22:19.789321 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 579/1181] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:22:19 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:22:19.800508 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-70c2b5ea-1faf-4ff6-a754-7713adb17cc5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '.version_select at 0x7f7d13670af0>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:19.821977 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-70c2b5ea-1faf-4ff6-a754-7713adb17cc5 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-231374187" status: 202 len: 0 microversion: 2.1 time: 0.027020 Jul 22 22:22:19.823351 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 603/1182] 10.222.0.110 () {58 vars in 1223 bytes} [Thu Jul 22 22:22:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-231374187 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:22:20.728057 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5a48915d-bcb3-49a2-afe1-d9b24bbfc2f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:20.728864 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5a48915d-bcb3-49a2-afe1-d9b24bbfc2f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:20.735481 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5a48915d-bcb3-49a2-afe1-d9b24bbfc2f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:20.735926 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5a48915d-bcb3-49a2-afe1-d9b24bbfc2f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:20.736736 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5a48915d-bcb3-49a2-afe1-d9b24bbfc2f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:20.737173 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5a48915d-bcb3-49a2-afe1-d9b24bbfc2f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:20.881859 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5a48915d-bcb3-49a2-afe1-d9b24bbfc2f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:20.891121 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5a48915d-bcb3-49a2-afe1-d9b24bbfc2f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:20.892797 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5a48915d-bcb3-49a2-afe1-d9b24bbfc2f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:20.894377 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5a48915d-bcb3-49a2-afe1-d9b24bbfc2f4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1720 microversion: 2.20 time: 0.170756 Jul 22 22:22:20.894994 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 580/1183] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:22:20 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:22:22.767059 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f12fc324-5333-46f2-8f1e-7184acf27a32 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:22.767560 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f12fc324-5333-46f2-8f1e-7184acf27a32 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:22.774239 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f12fc324-5333-46f2-8f1e-7184acf27a32 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:22.774687 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f12fc324-5333-46f2-8f1e-7184acf27a32 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:22.775464 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f12fc324-5333-46f2-8f1e-7184acf27a32 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:22.775912 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f12fc324-5333-46f2-8f1e-7184acf27a32 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:22.789857 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-f12fc324-5333-46f2-8f1e-7184acf27a32 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] HTTP exception thrown: Instance ba8f4f51-e0f7-44c6-9502-719ce8f4e606 could not be found. Jul 22 22:22:22.790443 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f12fc324-5333-46f2-8f1e-7184acf27a32 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Returning 404 to user: Instance ba8f4f51-e0f7-44c6-9502-719ce8f4e606 could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:22:22.791264 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f12fc324-5333-46f2-8f1e-7184acf27a32 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "DELETE /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 404 len: 111 microversion: 2.1 time: 0.028103 Jul 22 22:22:22.791798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 604/1184] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:22:22 2021] DELETE /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:22:22.799631 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1430168b-670c-474f-aa05-790dcdcf8859 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:22.800237 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1430168b-670c-474f-aa05-790dcdcf8859 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: ba8f4f51-e0f7-44c6-9502-719ce8f4e606] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:22.809623 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1430168b-670c-474f-aa05-790dcdcf8859 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:22.810094 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1430168b-670c-474f-aa05-790dcdcf8859 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:22.810871 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1430168b-670c-474f-aa05-790dcdcf8859 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:22.811374 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1430168b-670c-474f-aa05-790dcdcf8859 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:22.826158 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-1430168b-670c-474f-aa05-790dcdcf8859 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] HTTP exception thrown: Instance ba8f4f51-e0f7-44c6-9502-719ce8f4e606 could not be found. Jul 22 22:22:22.826762 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1430168b-670c-474f-aa05-790dcdcf8859 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Returning 404 to user: Instance ba8f4f51-e0f7-44c6-9502-719ce8f4e606 could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:22:22.827574 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1430168b-670c-474f-aa05-790dcdcf8859 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606" status: 404 len: 111 microversion: 2.1 time: 0.031640 Jul 22 22:22:22.828412 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 581/1185] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:22:22 2021] GET /compute/v2.1/servers/ba8f4f51-e0f7-44c6-9502-719ce8f4e606 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:22:23.978090 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ceb1aa80-9028-464b-8d99-96e77044b8d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:23.978704 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ceb1aa80-9028-464b-8d99-96e77044b8d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:23.985218 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ceb1aa80-9028-464b-8d99-96e77044b8d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:23.985820 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ceb1aa80-9028-464b-8d99-96e77044b8d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:23.987026 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ceb1aa80-9028-464b-8d99-96e77044b8d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:23.987681 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ceb1aa80-9028-464b-8d99-96e77044b8d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:24.002863 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-ceb1aa80-9028-464b-8d99-96e77044b8d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] HTTP exception thrown: Instance 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c could not be found. Jul 22 22:22:24.003666 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ceb1aa80-9028-464b-8d99-96e77044b8d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Returning 404 to user: Instance 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:22:24.004438 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ceb1aa80-9028-464b-8d99-96e77044b8d2 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "DELETE /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 404 len: 111 microversion: 2.1 time: 0.030756 Jul 22 22:22:24.005659 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 605/1186] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:22:23 2021] DELETE /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:22:24.013683 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a591a011-a71b-40dd-9f80-12502d850593 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:24.014290 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a591a011-a71b-40dd-9f80-12502d850593 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] [instance: 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:24.020268 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a591a011-a71b-40dd-9f80-12502d850593 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:24.021446 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a591a011-a71b-40dd-9f80-12502d850593 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:24.022204 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a591a011-a71b-40dd-9f80-12502d850593 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:24.022634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a591a011-a71b-40dd-9f80-12502d850593 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:24.036311 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-a591a011-a71b-40dd-9f80-12502d850593 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] HTTP exception thrown: Instance 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c could not be found. Jul 22 22:22:24.036905 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a591a011-a71b-40dd-9f80-12502d850593 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] Returning 404 to user: Instance 8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:22:24.037798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a591a011-a71b-40dd-9f80-12502d850593 tempest-AttachVolumeTestJSON-579115865 tempest-AttachVolumeTestJSON-579115865-project] 10.222.0.110 "GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c" status: 404 len: 111 microversion: 2.1 time: 0.027902 Jul 22 22:22:24.038269 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 582/1187] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:22:24 2021] GET /compute/v2.1/servers/8d75ab1e-8edd-4224-b2d1-1a9ec685ef4c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:22:28.831256 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6cfa9b9c-8fe6-4555-8a77-69d879eecbb6 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Action: 'create', calling method: .version_select at 0x7f7d1374fc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1044728847"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:22:29.157926 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6cfa9b9c-8fe6-4555-8a77-69d879eecbb6 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.446013 Jul 22 22:22:29.158770 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 606/1188] 10.222.0.110 () {60 vars in 1160 bytes} [Thu Jul 22 22:22:28 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 448 msecs (HTTP/1.1 200) 10 headers in 449 bytes (1 switches on core 0) Jul 22 22:22:29.173283 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9f4fc1a0-8d4c-4d3f-bebd-aa178fc24152 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d1c4ca670>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:29.235559 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9f4fc1a0-8d4c-4d3f-bebd-aa178fc24152 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340" status: 200 len: 345 microversion: 2.1 time: 0.067795 Jul 22 22:22:29.236226 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 583/1189] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:22:29 2021] GET /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:22:30.248695 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-734d73cc-0f0e-4107-ab14-1127a4a036ba tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d136a2ee0>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:30.299223 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-734d73cc-0f0e-4107-ab14-1127a4a036ba tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340" status: 200 len: 346 microversion: 2.1 time: 0.054129 Jul 22 22:22:30.299781 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 607/1190] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:22:30 2021] GET /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340 => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:30.311153 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c074f0c8-ceec-4ae1-939a-7c4cac9a1379 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Action: 'create', calling method: .version_select at 0x7f7d1c4dec10>, body: {"snapshot": {"volume_id": "f594e240-c71c-4b9d-b034-31eb00846340", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1816218845"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:22:30.455678 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c074f0c8-ceec-4ae1-939a-7c4cac9a1379 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.148004 Jul 22 22:22:30.456249 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 584/1191] 10.222.0.110 () {60 vars in 1167 bytes} [Thu Jul 22 22:22:30 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:30.465923 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-401111eb-37d3-47a7-8908-d92ee36cf970 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d136b1550>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:30.498274 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-401111eb-37d3-47a7-8908-d92ee36cf970 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e" status: 200 len: 287 microversion: 2.1 time: 0.035781 Jul 22 22:22:30.498945 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 608/1192] 10.222.0.110 () {58 vars in 1256 bytes} [Thu Jul 22 22:22:30 2021] GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:30.509531 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-02c1d4d6-c1ae-46b3-beeb-09092e49d77c tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d135ad280>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:30.539443 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-02c1d4d6-c1ae-46b3-beeb-09092e49d77c tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033563 Jul 22 22:22:30.540009 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 585/1193] 10.222.0.110 () {58 vars in 1145 bytes} [Thu Jul 22 22:22:30 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:22:30.549667 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d5114c9e-e9b3-4b05-932b-5a5a90731f34 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d1369da60>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:30.579537 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d5114c9e-e9b3-4b05-932b-5a5a90731f34 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e" status: 200 len: 287 microversion: 2.1 time: 0.033360 Jul 22 22:22:30.580090 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 609/1194] 10.222.0.110 () {58 vars in 1256 bytes} [Thu Jul 22 22:22:30 2021] GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:31.591165 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-6468d694-1184-42dc-9676-a93bda9fce1f tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d1c529c10>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:31.622480 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-6468d694-1184-42dc-9676-a93bda9fce1f tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e" status: 200 len: 287 microversion: 2.1 time: 0.034923 Jul 22 22:22:31.623038 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 586/1195] 10.222.0.110 () {58 vars in 1256 bytes} [Thu Jul 22 22:22:31 2021] GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:32.636904 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4950b816-6d6f-43b9-971f-1c15b9a6222d tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d136a2790>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:32.668083 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4950b816-6d6f-43b9-971f-1c15b9a6222d tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e" status: 200 len: 287 microversion: 2.1 time: 0.037028 Jul 22 22:22:32.668701 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 610/1196] 10.222.0.110 () {58 vars in 1256 bytes} [Thu Jul 22 22:22:32 2021] GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:33.679849 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bab1960b-66df-43f7-88b8-1d7e2f8a31d8 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d1c52d820>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:33.711829 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bab1960b-66df-43f7-88b8-1d7e2f8a31d8 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e" status: 200 len: 287 microversion: 2.1 time: 0.035619 Jul 22 22:22:33.712424 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 587/1197] 10.222.0.110 () {58 vars in 1256 bytes} [Thu Jul 22 22:22:33 2021] GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:34.722575 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8deb447c-84af-48e6-8991-c3f23b09a836 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d1374fb80>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:34.751951 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8deb447c-84af-48e6-8991-c3f23b09a836 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e" status: 200 len: 288 microversion: 2.1 time: 0.032989 Jul 22 22:22:34.752556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 611/1198] 10.222.0.110 () {58 vars in 1256 bytes} [Thu Jul 22 22:22:34 2021] GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:34.763064 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9edcee28-96a2-4781-bede-aac07712a910 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d1c4ca4c0>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:34.819423 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9edcee28-96a2-4781-bede-aac07712a910 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "DELETE /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e" status: 202 len: 0 microversion: 2.1 time: 0.059860 Jul 22 22:22:34.819997 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 588/1199] 10.222.0.110 () {58 vars in 1259 bytes} [Thu Jul 22 22:22:34 2021] DELETE /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:22:34.828685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-06ba51fd-5f5f-46c8-a9c7-9192897dd6f2 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d18289b80>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:34.858215 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-06ba51fd-5f5f-46c8-a9c7-9192897dd6f2 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e" status: 200 len: 287 microversion: 2.1 time: 0.033494 Jul 22 22:22:34.858865 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 612/1200] 10.222.0.110 () {58 vars in 1256 bytes} [Thu Jul 22 22:22:34 2021] GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:35.870249 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3cf23b78-bb79-4339-99b9-ef9b2ce5c41a tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d1c4de430>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:35.895734 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-3cf23b78-bb79-4339-99b9-ef9b2ce5c41a tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] HTTP exception thrown: Snapshot 7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e could not be found. Jul 22 22:22:35.897070 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3cf23b78-bb79-4339-99b9-ef9b2ce5c41a tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Returning 404 to user: Snapshot 7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:22:35.897889 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3cf23b78-bb79-4339-99b9-ef9b2ce5c41a tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e" status: 404 len: 111 microversion: 2.1 time: 0.031427 Jul 22 22:22:35.898418 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 589/1201] 10.222.0.110 () {58 vars in 1256 bytes} [Thu Jul 22 22:22:35 2021] GET /compute/v2.1/os-snapshots/7ca4c0d5-f61a-4e14-80f4-d7414b9adc3e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:22:35.906319 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fa9271a7-f4a2-4018-8ccb-d3fb63182a90 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d136ab940>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:35.966814 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fa9271a7-f4a2-4018-8ccb-d3fb63182a90 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340" status: 202 len: 0 microversion: 2.1 time: 0.064085 Jul 22 22:22:35.967380 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 613/1202] 10.222.0.110 () {58 vars in 1253 bytes} [Thu Jul 22 22:22:35 2021] DELETE /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:22:35.975569 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c44a5615-a955-496f-9998-7941209824a4 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d1c4ca8b0>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:36.031462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c44a5615-a955-496f-9998-7941209824a4 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340" status: 200 len: 345 microversion: 2.1 time: 0.059460 Jul 22 22:22:36.032025 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 590/1203] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:22:35 2021] GET /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:22:37.043407 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-db732150-e3b6-4c45-a4a5-8cd56b6c5272 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d136cef70>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:37.071251 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-db732150-e3b6-4c45-a4a5-8cd56b6c5272 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] HTTP exception thrown: Volume f594e240-c71c-4b9d-b034-31eb00846340 could not be found. Jul 22 22:22:37.071847 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-db732150-e3b6-4c45-a4a5-8cd56b6c5272 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Returning 404 to user: Volume f594e240-c71c-4b9d-b034-31eb00846340 could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:22:37.072703 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-db732150-e3b6-4c45-a4a5-8cd56b6c5272 tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340" status: 404 len: 109 microversion: 2.1 time: 0.032924 Jul 22 22:22:37.073235 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 614/1204] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:22:37 2021] GET /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 22:22:37.089568 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cf95c7f3-4575-4305-afb4-389bd4b768fa tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d13ff8280>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:37.118299 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-cf95c7f3-4575-4305-afb4-389bd4b768fa tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] HTTP exception thrown: Volume f594e240-c71c-4b9d-b034-31eb00846340 could not be found. Jul 22 22:22:37.119462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-cf95c7f3-4575-4305-afb4-389bd4b768fa tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Returning 404 to user: Volume f594e240-c71c-4b9d-b034-31eb00846340 could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:22:37.120488 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-cf95c7f3-4575-4305-afb4-389bd4b768fa tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340" status: 404 len: 109 microversion: 2.1 time: 0.034601 Jul 22 22:22:37.121085 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 591/1205] 10.222.0.110 () {58 vars in 1253 bytes} [Thu Jul 22 22:22:37 2021] DELETE /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:22:37.129358 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2b0705ad-cc69-4d5d-bfd2-972b98f97fba tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Calling method '.version_select at 0x7f7d136a2d30>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:37.157792 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-2b0705ad-cc69-4d5d-bfd2-972b98f97fba tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] HTTP exception thrown: Volume f594e240-c71c-4b9d-b034-31eb00846340 could not be found. Jul 22 22:22:37.158387 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2b0705ad-cc69-4d5d-bfd2-972b98f97fba tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] Returning 404 to user: Volume f594e240-c71c-4b9d-b034-31eb00846340 could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:22:37.159239 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2b0705ad-cc69-4d5d-bfd2-972b98f97fba tempest-VolumesSnapshotsTestJSON-1708935657 tempest-VolumesSnapshotsTestJSON-1708935657-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340" status: 404 len: 109 microversion: 2.1 time: 0.033964 Jul 22 22:22:37.159871 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 615/1206] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:22:37 2021] GET /compute/v2.1/os-volumes/f594e240-c71c-4b9d-b034-31eb00846340 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:22:57.687687 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-275330324", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1673230260", "security_groups": [{"name": "tempest-secgroup-smoke-1993943540"}], "block_device_mapping_v2": [{"uuid": "72e1a8bf-2b8f-457e-9ab9-90ec05f6f0dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7e529f4f-4b03-4451-832a-e468345894dd"}]}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:22:57.793608 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.network.neutron [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] validate_networks() for [('7e529f4f-4b03-4451-832a-e468345894dd', None, None, None)] {{(pid=107498) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:22:58.190940 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Flavor limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:22:58.191369 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Image limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:22:58.191838 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Flavor pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:22:58.192305 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Image pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:22:58.192712 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:22:58.201881 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:58.202323 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:58.203151 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:58.203578 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:58.219566 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Getting quotas for project 853ea27311ea40e185ea767354f4dec1. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:22:58.223898 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Getting quotas for user 4af694abdd744df1beb130211b80774a and project 853ea27311ea40e185ea767354f4dec1. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:22:58.293129 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Going to run 1 instances... {{(pid=107498) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:22:58.295283 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72e1a8bf-2b8f-457e-9ab9-90ec05f6f0dc',volume_size=None,volume_type=None)] {{(pid=107498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:22:58.420521 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e153e12c-21c0-4a92-a773-dbf9f74b9f18 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.737197 Jul 22 22:22:58.421147 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 592/1207] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:22:57 2021] POST /compute/v2.1/servers => generated 408 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:22:58.431959 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-24657ae3-fe9a-477d-9880-758adcdeb804 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:58.432563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-24657ae3-fe9a-477d-9880-758adcdeb804 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:58.489865 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-24657ae3-fe9a-477d-9880-758adcdeb804 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:58.497121 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-24657ae3-fe9a-477d-9880-758adcdeb804 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1097 microversion: 2.1 time: 0.069372 Jul 22 22:22:58.497666 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 616/1208] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:22:58 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1097 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:22:59.515213 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-695bb338-5d3f-4c15-b594-122d46066ac3 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:22:59.515758 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-695bb338-5d3f-4c15-b594-122d46066ac3 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:22:59.523935 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-695bb338-5d3f-4c15-b594-122d46066ac3 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:59.524357 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-695bb338-5d3f-4c15-b594-122d46066ac3 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:59.525210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-695bb338-5d3f-4c15-b594-122d46066ac3 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:22:59.525563 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-695bb338-5d3f-4c15-b594-122d46066ac3 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:22:59.589165 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-695bb338-5d3f-4c15-b594-122d46066ac3 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:22:59.598978 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-695bb338-5d3f-4c15-b594-122d46066ac3 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1195 microversion: 2.1 time: 0.088008 Jul 22 22:22:59.599552 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 593/1209] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:22:59 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1195 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:00.616183 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1527f223-83f3-4d8b-97e9-b6ecebfab338 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:00.616780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1527f223-83f3-4d8b-97e9-b6ecebfab338 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:00.622862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1527f223-83f3-4d8b-97e9-b6ecebfab338 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:00.623363 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1527f223-83f3-4d8b-97e9-b6ecebfab338 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:00.624141 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1527f223-83f3-4d8b-97e9-b6ecebfab338 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:00.624606 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1527f223-83f3-4d8b-97e9-b6ecebfab338 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:00.867147 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1527f223-83f3-4d8b-97e9-b6ecebfab338 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:00.875334 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1527f223-83f3-4d8b-97e9-b6ecebfab338 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1281 microversion: 2.1 time: 0.263075 Jul 22 22:23:00.875905 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 617/1210] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:00 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1281 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:01.166697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-ecbbf055-9efb-415c-a7bb-42274f4eef51 req-2d7a4336-5f64-43fb-9aa0-f9e31e832297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2161e34f-3610-4f6c-8f03-7ff89ef2c8ad", "tag": "ef2cf38b-40af-4b6a-be31-b0fa0cc57a37"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:01.168944 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:23:01.168944 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:23:01.195376 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-ecbbf055-9efb-415c-a7bb-42274f4eef51 req-2d7a4336-5f64-43fb-9aa0-f9e31e832297 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:01.198218 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-ecbbf055-9efb-415c-a7bb-42274f4eef51 req-2d7a4336-5f64-43fb-9aa0-f9e31e832297 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:01.227411 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-ecbbf055-9efb-415c-a7bb-42274f4eef51 req-2d7a4336-5f64-43fb-9aa0-f9e31e832297 service nova] Creating event network-changed:ef2cf38b-40af-4b6a-be31-b0fa0cc57a37 for instance 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad on hv-cinder-80186 Jul 22 22:23:01.234549 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-ecbbf055-9efb-415c-a7bb-42274f4eef51 req-2d7a4336-5f64-43fb-9aa0-f9e31e832297 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071918 Jul 22 22:23:01.236210 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 594/1211] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:23:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:01.893048 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-55ef0b84-28d0-46d0-8657-9dbf39513bec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:01.893705 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-55ef0b84-28d0-46d0-8657-9dbf39513bec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:01.900323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55ef0b84-28d0-46d0-8657-9dbf39513bec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:01.900839 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55ef0b84-28d0-46d0-8657-9dbf39513bec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:01.901612 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55ef0b84-28d0-46d0-8657-9dbf39513bec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:01.902043 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-55ef0b84-28d0-46d0-8657-9dbf39513bec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:02.169239 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-55ef0b84-28d0-46d0-8657-9dbf39513bec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:02.177411 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-55ef0b84-28d0-46d0-8657-9dbf39513bec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1269 microversion: 2.1 time: 0.288029 Jul 22 22:23:02.184429 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 618/1212] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:01 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1269 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:03.194904 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-db5cde84-e841-4510-9812-0d2b35364a44 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:03.195606 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-db5cde84-e841-4510-9812-0d2b35364a44 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:03.201997 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-db5cde84-e841-4510-9812-0d2b35364a44 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:03.202443 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-db5cde84-e841-4510-9812-0d2b35364a44 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:03.203290 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-db5cde84-e841-4510-9812-0d2b35364a44 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:03.203661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-db5cde84-e841-4510-9812-0d2b35364a44 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:03.350984 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-db5cde84-e841-4510-9812-0d2b35364a44 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:03.358273 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-db5cde84-e841-4510-9812-0d2b35364a44 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1269 microversion: 2.1 time: 0.167846 Jul 22 22:23:03.358832 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 595/1213] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:03 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:04.375780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a0dd7681-320e-46f2-b4a9-cc3e0bbdfcec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:04.376498 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a0dd7681-320e-46f2-b4a9-cc3e0bbdfcec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:04.384084 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0dd7681-320e-46f2-b4a9-cc3e0bbdfcec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:04.384561 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0dd7681-320e-46f2-b4a9-cc3e0bbdfcec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:04.385330 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0dd7681-320e-46f2-b4a9-cc3e0bbdfcec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:04.385959 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a0dd7681-320e-46f2-b4a9-cc3e0bbdfcec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:04.526650 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a0dd7681-320e-46f2-b4a9-cc3e0bbdfcec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:04.533898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a0dd7681-320e-46f2-b4a9-cc3e0bbdfcec tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1269 microversion: 2.1 time: 0.161769 Jul 22 22:23:04.535066 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 619/1214] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:04 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:05.551747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3db5802b-1b9d-45b5-8097-57caf2dbf1e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:05.552632 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-3db5802b-1b9d-45b5-8097-57caf2dbf1e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:05.558784 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3db5802b-1b9d-45b5-8097-57caf2dbf1e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:05.559233 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3db5802b-1b9d-45b5-8097-57caf2dbf1e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:05.560017 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3db5802b-1b9d-45b5-8097-57caf2dbf1e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:05.560496 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-3db5802b-1b9d-45b5-8097-57caf2dbf1e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:05.698715 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-3db5802b-1b9d-45b5-8097-57caf2dbf1e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:05.707380 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3db5802b-1b9d-45b5-8097-57caf2dbf1e6 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1269 microversion: 2.1 time: 0.159832 Jul 22 22:23:05.708083 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 596/1215] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:05 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:06.724210 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-aaf51511-5568-4bc6-aefc-74ecbc5dbc4f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:06.724929 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-aaf51511-5568-4bc6-aefc-74ecbc5dbc4f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:06.731774 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aaf51511-5568-4bc6-aefc-74ecbc5dbc4f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:06.732613 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aaf51511-5568-4bc6-aefc-74ecbc5dbc4f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:06.733656 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aaf51511-5568-4bc6-aefc-74ecbc5dbc4f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:06.734104 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-aaf51511-5568-4bc6-aefc-74ecbc5dbc4f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:06.884178 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-aaf51511-5568-4bc6-aefc-74ecbc5dbc4f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:06.891418 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-aaf51511-5568-4bc6-aefc-74ecbc5dbc4f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1269 microversion: 2.1 time: 0.170866 Jul 22 22:23:06.891985 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 620/1216] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:06 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1269 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:07.908115 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1c05106f-8ba1-438d-8fc5-dab9bd6ed6f2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:07.908747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1c05106f-8ba1-438d-8fc5-dab9bd6ed6f2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:07.915611 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1c05106f-8ba1-438d-8fc5-dab9bd6ed6f2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:07.916062 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1c05106f-8ba1-438d-8fc5-dab9bd6ed6f2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:07.916858 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1c05106f-8ba1-438d-8fc5-dab9bd6ed6f2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:07.917300 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1c05106f-8ba1-438d-8fc5-dab9bd6ed6f2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:08.057472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1c05106f-8ba1-438d-8fc5-dab9bd6ed6f2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:08.064685 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1c05106f-8ba1-438d-8fc5-dab9bd6ed6f2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1269 microversion: 2.1 time: 0.160192 Jul 22 22:23:08.065324 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 597/1217] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:07 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:09.081625 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-bc966069-58a4-4c06-9b15-658f58e4e67f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:09.082274 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-bc966069-58a4-4c06-9b15-658f58e4e67f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:09.088457 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bc966069-58a4-4c06-9b15-658f58e4e67f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:09.088907 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bc966069-58a4-4c06-9b15-658f58e4e67f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:09.089696 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bc966069-58a4-4c06-9b15-658f58e4e67f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:09.090123 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-bc966069-58a4-4c06-9b15-658f58e4e67f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:09.227575 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-bc966069-58a4-4c06-9b15-658f58e4e67f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:09.234978 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-bc966069-58a4-4c06-9b15-658f58e4e67f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1269 microversion: 2.1 time: 0.157526 Jul 22 22:23:09.235532 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 621/1218] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:09 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:10.085664 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-04b95e53-e6ca-46a9-873d-9dc95aca924a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:10.086184 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-04b95e53-e6ca-46a9-873d-9dc95aca924a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:10.092176 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04b95e53-e6ca-46a9-873d-9dc95aca924a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:10.092643 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04b95e53-e6ca-46a9-873d-9dc95aca924a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:10.093424 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04b95e53-e6ca-46a9-873d-9dc95aca924a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:10.093850 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-04b95e53-e6ca-46a9-873d-9dc95aca924a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:10.119309 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-04b95e53-e6ca-46a9-873d-9dc95aca924a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:23:10.198200 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-04b95e53-e6ca-46a9-873d-9dc95aca924a tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "DELETE /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 204 len: 0 microversion: 2.20 time: 0.115969 Jul 22 22:23:10.198912 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 598/1219] 10.222.0.110 () {60 vars in 1285 bytes} [Thu Jul 22 22:23:10 2021] DELETE /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 22 22:23:10.207737 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-779ea73a-def3-464e-b4d3-c4e038606525 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:10.208371 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-779ea73a-def3-464e-b4d3-c4e038606525 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:10.214201 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-779ea73a-def3-464e-b4d3-c4e038606525 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:10.214644 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-779ea73a-def3-464e-b4d3-c4e038606525 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:10.215404 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-779ea73a-def3-464e-b4d3-c4e038606525 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:10.215838 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-779ea73a-def3-464e-b4d3-c4e038606525 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:10.253372 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-17c2a1b7-3816-4ea0-9bca-3fabc9ff22df tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:10.254103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-17c2a1b7-3816-4ea0-9bca-3fabc9ff22df tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:10.259980 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17c2a1b7-3816-4ea0-9bca-3fabc9ff22df tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:10.260460 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17c2a1b7-3816-4ea0-9bca-3fabc9ff22df tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:10.261238 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17c2a1b7-3816-4ea0-9bca-3fabc9ff22df tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:10.261668 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-17c2a1b7-3816-4ea0-9bca-3fabc9ff22df tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:10.355100 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-779ea73a-def3-464e-b4d3-c4e038606525 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:10.363757 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-779ea73a-def3-464e-b4d3-c4e038606525 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:10.365485 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-779ea73a-def3-464e-b4d3-c4e038606525 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:10.366558 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-779ea73a-def3-464e-b4d3-c4e038606525 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.163209 Jul 22 22:23:10.367114 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 622/1220] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:23:10 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 22 22:23:10.406460 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-17c2a1b7-3816-4ea0-9bca-3fabc9ff22df tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:10.415185 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-17c2a1b7-3816-4ea0-9bca-3fabc9ff22df tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1269 microversion: 2.1 time: 0.167103 Jul 22 22:23:10.415755 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 599/1221] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:10 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1269 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:23:11.386522 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6c50cd5e-1988-4263-a4bf-ff38f670f1a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:11.387153 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6c50cd5e-1988-4263-a4bf-ff38f670f1a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:11.393676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6c50cd5e-1988-4263-a4bf-ff38f670f1a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:11.394236 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6c50cd5e-1988-4263-a4bf-ff38f670f1a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:11.395288 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6c50cd5e-1988-4263-a4bf-ff38f670f1a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:11.396064 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6c50cd5e-1988-4263-a4bf-ff38f670f1a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:11.431359 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1029125c-46df-4442-b6fa-a4cf681bd123 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:11.431913 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1029125c-46df-4442-b6fa-a4cf681bd123 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:11.437885 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1029125c-46df-4442-b6fa-a4cf681bd123 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:11.438337 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1029125c-46df-4442-b6fa-a4cf681bd123 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:11.439120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1029125c-46df-4442-b6fa-a4cf681bd123 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:11.439562 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1029125c-46df-4442-b6fa-a4cf681bd123 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:11.533664 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6c50cd5e-1988-4263-a4bf-ff38f670f1a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:11.541862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6c50cd5e-1988-4263-a4bf-ff38f670f1a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:11.543358 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6c50cd5e-1988-4263-a4bf-ff38f670f1a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:11.544528 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6c50cd5e-1988-4263-a4bf-ff38f670f1a6 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.162678 Jul 22 22:23:11.545083 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 623/1222] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:23:11 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:23:11.576647 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1029125c-46df-4442-b6fa-a4cf681bd123 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:11.584000 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1029125c-46df-4442-b6fa-a4cf681bd123 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1269 microversion: 2.1 time: 0.156335 Jul 22 22:23:11.584592 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 600/1223] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:11 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:23:11.936417 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-ba60b65a-84a7-4789-a38e-dab13fbbffff req-1c3e627c-19bd-4886-bc97-4ed6b7b90df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2161e34f-3610-4f6c-8f03-7ff89ef2c8ad", "name": "network-vif-plugged", "status": "completed", "tag": "ef2cf38b-40af-4b6a-be31-b0fa0cc57a37"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:11.938016 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:23:11.938016 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:23:11.945446 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-ba60b65a-84a7-4789-a38e-dab13fbbffff req-1c3e627c-19bd-4886-bc97-4ed6b7b90df9 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:11.945890 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-ba60b65a-84a7-4789-a38e-dab13fbbffff req-1c3e627c-19bd-4886-bc97-4ed6b7b90df9 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:11.958268 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-ba60b65a-84a7-4789-a38e-dab13fbbffff req-1c3e627c-19bd-4886-bc97-4ed6b7b90df9 service nova] Creating event network-vif-plugged:ef2cf38b-40af-4b6a-be31-b0fa0cc57a37 for instance 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad on hv-cinder-80186 Jul 22 22:23:11.962767 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-ba60b65a-84a7-4789-a38e-dab13fbbffff req-1c3e627c-19bd-4886-bc97-4ed6b7b90df9 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030035 Jul 22 22:23:11.963360 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 624/1224] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:23:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:12.562039 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ccddb2ed-f9fa-4a22-84a0-a71648fdcee7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:12.562637 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ccddb2ed-f9fa-4a22-84a0-a71648fdcee7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:12.569668 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ccddb2ed-f9fa-4a22-84a0-a71648fdcee7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:12.570105 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ccddb2ed-f9fa-4a22-84a0-a71648fdcee7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:12.570864 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ccddb2ed-f9fa-4a22-84a0-a71648fdcee7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:12.571291 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ccddb2ed-f9fa-4a22-84a0-a71648fdcee7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:12.600729 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2bdc91c6-d881-4dd7-842a-df00de609703 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:12.601338 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2bdc91c6-d881-4dd7-842a-df00de609703 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:12.607600 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2bdc91c6-d881-4dd7-842a-df00de609703 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:12.608041 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2bdc91c6-d881-4dd7-842a-df00de609703 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:12.608849 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2bdc91c6-d881-4dd7-842a-df00de609703 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:12.609275 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2bdc91c6-d881-4dd7-842a-df00de609703 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:12.715503 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ccddb2ed-f9fa-4a22-84a0-a71648fdcee7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:12.723878 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ccddb2ed-f9fa-4a22-84a0-a71648fdcee7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:12.725422 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ccddb2ed-f9fa-4a22-84a0-a71648fdcee7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:12.726563 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ccddb2ed-f9fa-4a22-84a0-a71648fdcee7 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.168257 Jul 22 22:23:12.727103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 601/1225] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:23:12 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:23:12.753837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2bdc91c6-d881-4dd7-842a-df00de609703 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:12.761475 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2bdc91c6-d881-4dd7-842a-df00de609703 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1269 microversion: 2.1 time: 0.164846 Jul 22 22:23:12.762041 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 625/1226] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:12 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:23:13.745004 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bc68be2f-011f-401b-858c-bc9e84d72e47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:13.745602 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bc68be2f-011f-401b-858c-bc9e84d72e47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:13.751342 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bc68be2f-011f-401b-858c-bc9e84d72e47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:13.751789 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bc68be2f-011f-401b-858c-bc9e84d72e47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:13.752625 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bc68be2f-011f-401b-858c-bc9e84d72e47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:13.753390 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bc68be2f-011f-401b-858c-bc9e84d72e47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:13.778605 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ccab3635-e305-46f3-9564-d9a12d9c77ae tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:13.779186 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ccab3635-e305-46f3-9564-d9a12d9c77ae tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:13.787522 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ccab3635-e305-46f3-9564-d9a12d9c77ae tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:13.788052 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ccab3635-e305-46f3-9564-d9a12d9c77ae tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:13.788908 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ccab3635-e305-46f3-9564-d9a12d9c77ae tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:13.789477 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ccab3635-e305-46f3-9564-d9a12d9c77ae tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:13.902716 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bc68be2f-011f-401b-858c-bc9e84d72e47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:13.911621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bc68be2f-011f-401b-858c-bc9e84d72e47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:13.914250 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bc68be2f-011f-401b-858c-bc9e84d72e47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:13.915429 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bc68be2f-011f-401b-858c-bc9e84d72e47 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1726 microversion: 2.20 time: 0.174146 Jul 22 22:23:13.915988 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 602/1227] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:23:13 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:23:14.065677 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ccab3635-e305-46f3-9564-d9a12d9c77ae tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:14.073178 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ccab3635-e305-46f3-9564-d9a12d9c77ae tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1269 microversion: 2.1 time: 0.298949 Jul 22 22:23:14.073755 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 626/1228] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:13 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1269 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:23:14.270220 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-e6cc7943-183c-4155-8361-ed9e56d413d0 req-4e1eb202-ceb1-4cc4-94e2-f777180de79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39a594cb-1699-4423-9bf3-f141ab59ad1d", "name": "network-vif-deleted", "tag": "faef284b-3bc0-45b4-9175-e5021628b786"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:14.271815 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:23:14.271815 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:23:14.279060 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-e6cc7943-183c-4155-8361-ed9e56d413d0 req-4e1eb202-ceb1-4cc4-94e2-f777180de79e service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:14.279462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-e6cc7943-183c-4155-8361-ed9e56d413d0 req-4e1eb202-ceb1-4cc4-94e2-f777180de79e service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:14.294402 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-e6cc7943-183c-4155-8361-ed9e56d413d0 req-4e1eb202-ceb1-4cc4-94e2-f777180de79e service nova] Creating event network-vif-deleted:faef284b-3bc0-45b4-9175-e5021628b786 for instance 39a594cb-1699-4423-9bf3-f141ab59ad1d on hv-cinder-80186 Jul 22 22:23:14.300814 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-e6cc7943-183c-4155-8361-ed9e56d413d0 req-4e1eb202-ceb1-4cc4-94e2-f777180de79e service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034686 Jul 22 22:23:14.301437 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 603/1229] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:23:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:14.932872 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:14.934226 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:14.940612 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:14.941065 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:14.942316 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:14.942758 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:14.983909 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:14.984417 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:14.984951 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lazy-loading 'fault' on Instance uuid 39a594cb-1699-4423-9bf3-f141ab59ad1d {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:23:15.037269 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:15.045622 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:15.047134 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b12a8e4c8635473d9973af215bcbcc46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c7420429ec848f6a4c1ad81eebaf705', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:15.048298 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-95983b72-5ea9-481b-be1c-fc91c00b6b53 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 200 len: 1374 microversion: 2.20 time: 0.119121 Jul 22 22:23:15.048851 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 627/1230] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:23:14 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 1374 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 22 22:23:15.090220 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8dabcd5b-dcbd-4073-bf87-285f5d1a5c1a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:15.091533 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8dabcd5b-dcbd-4073-bf87-285f5d1a5c1a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:15.100803 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8dabcd5b-dcbd-4073-bf87-285f5d1a5c1a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:15.101492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8dabcd5b-dcbd-4073-bf87-285f5d1a5c1a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:15.102603 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8dabcd5b-dcbd-4073-bf87-285f5d1a5c1a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:15.103146 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8dabcd5b-dcbd-4073-bf87-285f5d1a5c1a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:15.289232 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8dabcd5b-dcbd-4073-bf87-285f5d1a5c1a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:15.296660 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8dabcd5b-dcbd-4073-bf87-285f5d1a5c1a tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1456 microversion: 2.1 time: 0.210560 Jul 22 22:23:15.297228 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 604/1231] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:15 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1456 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:15.314546 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c79a89df-8a14-4f3c-a0a8-86517954dcf7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:15.316269 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c79a89df-8a14-4f3c-a0a8-86517954dcf7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:15.322192 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c79a89df-8a14-4f3c-a0a8-86517954dcf7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:15.322636 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c79a89df-8a14-4f3c-a0a8-86517954dcf7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:15.323575 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c79a89df-8a14-4f3c-a0a8-86517954dcf7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:15.324408 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c79a89df-8a14-4f3c-a0a8-86517954dcf7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:15.485672 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c79a89df-8a14-4f3c-a0a8-86517954dcf7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:15.493169 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c79a89df-8a14-4f3c-a0a8-86517954dcf7 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1456 microversion: 2.1 time: 0.182969 Jul 22 22:23:15.493743 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 628/1232] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:15 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1456 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:16.067630 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0dc2bd19-e094-4e69-82df-7d8578c29150 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:16.068428 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0dc2bd19-e094-4e69-82df-7d8578c29150 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:16.075022 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dc2bd19-e094-4e69-82df-7d8578c29150 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:16.075476 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dc2bd19-e094-4e69-82df-7d8578c29150 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:16.076261 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dc2bd19-e094-4e69-82df-7d8578c29150 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:16.076724 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dc2bd19-e094-4e69-82df-7d8578c29150 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:16.092798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-0dc2bd19-e094-4e69-82df-7d8578c29150 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] HTTP exception thrown: Instance 39a594cb-1699-4423-9bf3-f141ab59ad1d could not be found. Jul 22 22:23:16.093518 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0dc2bd19-e094-4e69-82df-7d8578c29150 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Returning 404 to user: Instance 39a594cb-1699-4423-9bf3-f141ab59ad1d could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:16.094386 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0dc2bd19-e094-4e69-82df-7d8578c29150 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 404 len: 111 microversion: 2.20 time: 0.030890 Jul 22 22:23:16.095358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 605/1233] 10.222.0.110 () {60 vars in 1282 bytes} [Thu Jul 22 22:23:16 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 22 22:23:16.104847 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fe15e603-faf3-4b97-b38a-549433211ead tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '.version_select at 0x7f7d136703a0>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:16.130000 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fe15e603-faf3-4b97-b38a-549433211ead tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955646166" status: 204 len: 0 microversion: 2.20 time: 0.029180 Jul 22 22:23:16.132412 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 629/1234] 10.222.0.110 () {60 vars in 1264 bytes} [Thu Jul 22 22:23:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955646166 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 22 22:23:17.696404 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-1127fe30-cd71-4fc4-a22c-26667bbbdebd req-7657f201-877f-40ca-a197-029729faf437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2161e34f-3610-4f6c-8f03-7ff89ef2c8ad", "tag": "ef2cf38b-40af-4b6a-be31-b0fa0cc57a37"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:17.697903 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:23:17.697903 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:23:17.705269 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-1127fe30-cd71-4fc4-a22c-26667bbbdebd req-7657f201-877f-40ca-a197-029729faf437 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:17.706316 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-1127fe30-cd71-4fc4-a22c-26667bbbdebd req-7657f201-877f-40ca-a197-029729faf437 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:17.719620 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-1127fe30-cd71-4fc4-a22c-26667bbbdebd req-7657f201-877f-40ca-a197-029729faf437 service nova] Creating event network-changed:ef2cf38b-40af-4b6a-be31-b0fa0cc57a37 for instance 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad on hv-cinder-80186 Jul 22 22:23:17.726011 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-1127fe30-cd71-4fc4-a22c-26667bbbdebd req-7657f201-877f-40ca-a197-029729faf437 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033105 Jul 22 22:23:17.726928 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 606/1235] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:23:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:22.493894 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3240acc6-f6f1-4368-92a6-bcfecae3d17d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:22.494477 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3240acc6-f6f1-4368-92a6-bcfecae3d17d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:22.500528 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3240acc6-f6f1-4368-92a6-bcfecae3d17d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:22.501002 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3240acc6-f6f1-4368-92a6-bcfecae3d17d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:22.501869 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3240acc6-f6f1-4368-92a6-bcfecae3d17d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:22.503075 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3240acc6-f6f1-4368-92a6-bcfecae3d17d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:22.516718 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-3240acc6-f6f1-4368-92a6-bcfecae3d17d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] HTTP exception thrown: Instance 39a594cb-1699-4423-9bf3-f141ab59ad1d could not be found. Jul 22 22:23:22.517303 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3240acc6-f6f1-4368-92a6-bcfecae3d17d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Returning 404 to user: Instance 39a594cb-1699-4423-9bf3-f141ab59ad1d could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:22.518299 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3240acc6-f6f1-4368-92a6-bcfecae3d17d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "DELETE /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 404 len: 111 microversion: 2.1 time: 0.028163 Jul 22 22:23:22.518844 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 630/1236] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:23:22 2021] DELETE /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:23:22.527333 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-24078c25-d300-454f-8965-336a4b8f84e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:22.528023 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-24078c25-d300-454f-8965-336a4b8f84e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 39a594cb-1699-4423-9bf3-f141ab59ad1d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:22.534609 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24078c25-d300-454f-8965-336a4b8f84e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:22.535058 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24078c25-d300-454f-8965-336a4b8f84e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:22.535823 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24078c25-d300-454f-8965-336a4b8f84e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:22.536256 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-24078c25-d300-454f-8965-336a4b8f84e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:22.549797 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-24078c25-d300-454f-8965-336a4b8f84e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] HTTP exception thrown: Instance 39a594cb-1699-4423-9bf3-f141ab59ad1d could not be found. Jul 22 22:23:22.550394 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-24078c25-d300-454f-8965-336a4b8f84e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Returning 404 to user: Instance 39a594cb-1699-4423-9bf3-f141ab59ad1d could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:22.551211 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-24078c25-d300-454f-8965-336a4b8f84e4 tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d" status: 404 len: 111 microversion: 2.1 time: 0.028074 Jul 22 22:23:22.551731 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 607/1237] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:22 2021] GET /compute/v2.1/servers/39a594cb-1699-4423-9bf3-f141ab59ad1d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:23:23.687152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-91f89040-a95c-4b8b-b506-c226a7c1130d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:23.687644 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-91f89040-a95c-4b8b-b506-c226a7c1130d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:23.694668 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-91f89040-a95c-4b8b-b506-c226a7c1130d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:23.695116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-91f89040-a95c-4b8b-b506-c226a7c1130d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:23.695884 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-91f89040-a95c-4b8b-b506-c226a7c1130d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:23.696371 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-91f89040-a95c-4b8b-b506-c226a7c1130d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:23.710620 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-91f89040-a95c-4b8b-b506-c226a7c1130d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] HTTP exception thrown: Instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 could not be found. Jul 22 22:23:23.711206 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-91f89040-a95c-4b8b-b506-c226a7c1130d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Returning 404 to user: Instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:23.712030 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-91f89040-a95c-4b8b-b506-c226a7c1130d tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "DELETE /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 404 len: 111 microversion: 2.1 time: 0.028565 Jul 22 22:23:23.712605 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 631/1238] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:23:23 2021] DELETE /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 22:23:23.723638 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-842812dd-2b05-4642-b913-313638a2cc9c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:23.724258 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-842812dd-2b05-4642-b913-313638a2cc9c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] [instance: 61e7dd91-3f55-48c9-85aa-84c2450719f2] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:23.730331 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-842812dd-2b05-4642-b913-313638a2cc9c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:23.730777 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-842812dd-2b05-4642-b913-313638a2cc9c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:23.731577 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-842812dd-2b05-4642-b913-313638a2cc9c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:23.732008 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-842812dd-2b05-4642-b913-313638a2cc9c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:23.745295 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-842812dd-2b05-4642-b913-313638a2cc9c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] HTTP exception thrown: Instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 could not be found. Jul 22 22:23:23.745901 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-842812dd-2b05-4642-b913-313638a2cc9c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] Returning 404 to user: Instance 61e7dd91-3f55-48c9-85aa-84c2450719f2 could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:23.746722 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-842812dd-2b05-4642-b913-313638a2cc9c tempest-AttachVolumeShelveTestJSON-1167290887 tempest-AttachVolumeShelveTestJSON-1167290887-project] 10.222.0.110 "GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2" status: 404 len: 111 microversion: 2.1 time: 0.029696 Jul 22 22:23:23.747261 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 608/1239] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:23 2021] GET /compute/v2.1/servers/61e7dd91-3f55-48c9-85aa-84c2450719f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:23:28.401478 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-06e7876a-a681-461a-9c08-973cf3b31dd9 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] Action: 'create', calling method: .version_select at 0x7f7d1374f940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-649160980", "metadata": {"Type": "work"}}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:28.802206 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-06e7876a-a681-461a-9c08-973cf3b31dd9 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] 10.222.0.110 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.517512 Jul 22 22:23:28.802942 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 632/1240] 10.222.0.110 () {60 vars in 1161 bytes} [Thu Jul 22 22:23:28 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 519 msecs (HTTP/1.1 200) 10 headers in 449 bytes (2 switches on core 0) Jul 22 22:23:28.814127 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9dbee19d-273b-431e-90b9-b94b51d208c9 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] Calling method '.version_select at 0x7f7d1c4ca820>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:28.927207 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9dbee19d-273b-431e-90b9-b94b51d208c9 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17" status: 200 len: 352 microversion: 2.1 time: 0.116450 Jul 22 22:23:28.928245 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 609/1241] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:23:28 2021] GET /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:29.940711 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-06fe18eb-5d91-4a68-a3f7-6d423b7bff97 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] Calling method '.version_select at 0x7f7d13670b80>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:29.993830 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-06fe18eb-5d91-4a68-a3f7-6d423b7bff97 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17" status: 200 len: 353 microversion: 2.1 time: 0.057477 Jul 22 22:23:29.994390 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 633/1242] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:23:29 2021] GET /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:30.005667 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-3a27e618-3cd7-4bc1-b4e4-5541d25218ec tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] Calling method '.version_select at 0x7f7d1c52daf0>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:30.060807 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-3a27e618-3cd7-4bc1-b4e4-5541d25218ec tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17" status: 200 len: 353 microversion: 2.1 time: 0.059309 Jul 22 22:23:30.061357 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 610/1243] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:23:30 2021] GET /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17 => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:30.073965 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3b0e2902-f33f-44f5-9dcb-f4afdea25655 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] Calling method '.version_select at 0x7f7d136b11f0>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:30.138210 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3b0e2902-f33f-44f5-9dcb-f4afdea25655 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17" status: 202 len: 0 microversion: 2.1 time: 0.067563 Jul 22 22:23:30.139045 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 634/1244] 10.222.0.110 () {58 vars in 1253 bytes} [Thu Jul 22 22:23:30 2021] DELETE /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:23:30.150950 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-50535a2b-37c2-43c9-88ad-aafb84606232 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] Calling method '.version_select at 0x7f7d1c529280>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:30.216248 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-50535a2b-37c2-43c9-88ad-aafb84606232 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17" status: 200 len: 352 microversion: 2.1 time: 0.071193 Jul 22 22:23:30.216841 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 611/1245] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:23:30 2021] GET /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17 => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:31.212787 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:23:31.213391 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: Thu Jul 22 22:23:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:23:31.230601 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-26a2e84f-02e1-43c8-b3d1-f1200ed49dd0 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] Calling method '.version_select at 0x7f7d136ce280>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:31.262860 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-26a2e84f-02e1-43c8-b3d1-f1200ed49dd0 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] HTTP exception thrown: Volume 264dbe67-3055-40bb-96b2-5b267a13cc17 could not be found. Jul 22 22:23:31.263531 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-26a2e84f-02e1-43c8-b3d1-f1200ed49dd0 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] Returning 404 to user: Volume 264dbe67-3055-40bb-96b2-5b267a13cc17 could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:31.264343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-26a2e84f-02e1-43c8-b3d1-f1200ed49dd0 tempest-VolumesGetTestJSON-904162715 tempest-VolumesGetTestJSON-904162715-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17" status: 404 len: 109 microversion: 2.1 time: 0.038220 Jul 22 22:23:31.264895 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 635/1246] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:23:31 2021] GET /compute/v2.1/os-volumes/264dbe67-3055-40bb-96b2-5b267a13cc17 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 22:23:32.663571 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-31205c60-896b-4047-80da-fa75543c37c1 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Action: 'create', calling method: .version_select at 0x7f7d1c529040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-983614722", "metadata": {"Type": "work"}}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:32.664465 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-31205c60-896b-4047-80da-fa75543c37c1 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:32.665276 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-31205c60-896b-4047-80da-fa75543c37c1 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] 10.222.0.110 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.121899 Jul 22 22:23:32.665803 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 612/1247] 10.222.0.110 () {60 vars in 1161 bytes} [Thu Jul 22 22:23:32 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 22 22:23:32.675874 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d86a537b-490d-46ce-87ab-2a92d5c09ba0 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Action: 'create', calling method: .version_select at 0x7f7d1369d430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1725913416", "metadata": {"Type": "work"}}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:32.677299 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d86a537b-490d-46ce-87ab-2a92d5c09ba0 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:32.678090 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d86a537b-490d-46ce-87ab-2a92d5c09ba0 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] 10.222.0.110 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006978 Jul 22 22:23:32.678608 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 636/1248] 10.222.0.110 () {60 vars in 1161 bytes} [Thu Jul 22 22:23:32 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 22 22:23:32.687334 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-90bba513-4886-4cc7-b6bc-eecb57a7d178 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Action: 'create', calling method: .version_select at 0x7f7d1353a670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2110744008", "metadata": {"Type": "work"}}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:32.688764 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-90bba513-4886-4cc7-b6bc-eecb57a7d178 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:32.689771 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-90bba513-4886-4cc7-b6bc-eecb57a7d178 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] 10.222.0.110 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006233 Jul 22 22:23:32.690639 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 613/1249] 10.222.0.110 () {60 vars in 1161 bytes} [Thu Jul 22 22:23:32 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 22 22:23:32.699550 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6aaf6e6e-2b69-4240-9884-6e8f27af9685 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Calling method '.version_select at 0x7f7d136ce430>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:32.727620 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-6aaf6e6e-2b69-4240-9884-6e8f27af9685 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] HTTP exception thrown: Volume tempest-invalid-1045255697 could not be found. Jul 22 22:23:32.728191 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6aaf6e6e-2b69-4240-9884-6e8f27af9685 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Returning 404 to user: Volume tempest-invalid-1045255697 could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:32.729028 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6aaf6e6e-2b69-4240-9884-6e8f27af9685 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1045255697" status: 404 len: 99 microversion: 2.1 time: 0.033532 Jul 22 22:23:32.729552 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 637/1250] 10.222.0.110 () {58 vars in 1223 bytes} [Thu Jul 22 22:23:32 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1045255697 => generated 99 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 22 22:23:32.740011 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0afe08a8-1dea-4939-977f-1a6168d0b357 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005110 Jul 22 22:23:32.740568 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 614/1251] 10.222.0.110 () {58 vars in 1145 bytes} [Thu Jul 22 22:23:32 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 22 22:23:32.749211 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a4542025-d99f-470c-9f5c-8bdf32b956ac tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004032 Jul 22 22:23:32.749699 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 638/1252] 10.222.0.110 () {58 vars in 1142 bytes} [Thu Jul 22 22:23:32 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 22 22:23:32.758267 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-eab16b51-78a6-4488-a1bf-e62c99e68fe9 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Calling method '.version_select at 0x7f7d1353af70>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:32.786043 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-eab16b51-78a6-4488-a1bf-e62c99e68fe9 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] HTTP exception thrown: Volume 07702bd4-a316-41fc-94cf-e3ab16890f8a could not be found. Jul 22 22:23:32.786647 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-eab16b51-78a6-4488-a1bf-e62c99e68fe9 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Returning 404 to user: Volume 07702bd4-a316-41fc-94cf-e3ab16890f8a could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:32.787486 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-eab16b51-78a6-4488-a1bf-e62c99e68fe9 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] 10.222.0.110 "DELETE /compute/v2.1/os-volumes/07702bd4-a316-41fc-94cf-e3ab16890f8a" status: 404 len: 109 microversion: 2.1 time: 0.033040 Jul 22 22:23:32.788021 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 615/1253] 10.222.0.110 () {58 vars in 1253 bytes} [Thu Jul 22 22:23:32 2021] DELETE /compute/v2.1/os-volumes/07702bd4-a316-41fc-94cf-e3ab16890f8a => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:23:32.797093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4f6e1d1f-2be5-410f-a2d1-280fcd014c90 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Calling method '.version_select at 0x7f7d18289430>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:32.825198 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-4f6e1d1f-2be5-410f-a2d1-280fcd014c90 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] HTTP exception thrown: Volume d1ba7edc-aad2-4eca-8893-2d4217b7f77d could not be found. Jul 22 22:23:32.825798 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4f6e1d1f-2be5-410f-a2d1-280fcd014c90 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] Returning 404 to user: Volume d1ba7edc-aad2-4eca-8893-2d4217b7f77d could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:32.826616 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4f6e1d1f-2be5-410f-a2d1-280fcd014c90 tempest-VolumesNegativeTest-693255210 tempest-VolumesNegativeTest-693255210-project] 10.222.0.110 "GET /compute/v2.1/os-volumes/d1ba7edc-aad2-4eca-8893-2d4217b7f77d" status: 404 len: 109 microversion: 2.1 time: 0.033359 Jul 22 22:23:32.827141 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 639/1254] 10.222.0.110 () {58 vars in 1250 bytes} [Thu Jul 22 22:23:32 2021] GET /compute/v2.1/os-volumes/d1ba7edc-aad2-4eca-8893-2d4217b7f77d => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:23:37.834308 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2029346083", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:37.902894 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.network.neutron [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] validate_networks() for None {{(pid=107498) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:23:38.345107 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Flavor limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:23:38.345636 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Image limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:23:38.346317 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Flavor pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:23:38.346850 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Image pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:23:38.347445 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:23:38.357573 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:38.358030 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:38.358873 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:38.359316 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:38.378634 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Getting quotas for project 5f4ec5bb58cf47fc8dbbcacfdaa282b4. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:23:38.387099 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Getting quotas for user aa4ef28b34bd4acd87afbd52fdcbf2f4 and project 5f4ec5bb58cf47fc8dbbcacfdaa282b4. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:23:38.406256 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Going to run 1 instances... {{(pid=107498) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:23:38.414890 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:23:38.471406 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e29d0efa-fce5-436d-bf87-a02754cb04b1 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.641994 Jul 22 22:23:38.472315 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 616/1255] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:23:37 2021] POST /compute/v2.1/servers => generated 382 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 22 22:23:38.484790 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9cd40927-bc31-45f6-96dc-119eba5aa647 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:38.485339 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9cd40927-bc31-45f6-96dc-119eba5aa647 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:38.581810 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9cd40927-bc31-45f6-96dc-119eba5aa647 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:38.588295 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9cd40927-bc31-45f6-96dc-119eba5aa647 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1219 microversion: 2.1 time: 0.107320 Jul 22 22:23:38.591520 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 640/1256] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:38 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:39.609408 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-bf821111-681b-4652-a035-939629a30e96 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:39.610147 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-bf821111-681b-4652-a035-939629a30e96 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:39.619978 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bf821111-681b-4652-a035-939629a30e96 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:39.620496 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bf821111-681b-4652-a035-939629a30e96 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:39.621280 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bf821111-681b-4652-a035-939629a30e96 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:39.621719 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-bf821111-681b-4652-a035-939629a30e96 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:39.690862 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-bf821111-681b-4652-a035-939629a30e96 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:39.698897 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-bf821111-681b-4652-a035-939629a30e96 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1271 microversion: 2.1 time: 0.093868 Jul 22 22:23:39.699485 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 617/1257] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:39 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:40.243603 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1618031247", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "networks": [{"uuid": "cfece6d9-3805-4575-aed6-82a5dc944436"}]}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:40.308100 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.network.neutron [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] validate_networks() for [('cfece6d9-3805-4575-aed6-82a5dc944436', None, None, None)] {{(pid=107499) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:23:40.718445 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-18743f2c-540f-4ebe-904f-32fbce20d4b0 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:40.719202 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-18743f2c-540f-4ebe-904f-32fbce20d4b0 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:40.725456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18743f2c-540f-4ebe-904f-32fbce20d4b0 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:40.725907 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18743f2c-540f-4ebe-904f-32fbce20d4b0 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:40.726674 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18743f2c-540f-4ebe-904f-32fbce20d4b0 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:40.727097 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-18743f2c-540f-4ebe-904f-32fbce20d4b0 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:40.795213 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-18743f2c-540f-4ebe-904f-32fbce20d4b0 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:40.805225 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-18743f2c-540f-4ebe-904f-32fbce20d4b0 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1277 microversion: 2.1 time: 0.090410 Jul 22 22:23:40.805591 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 618/1258] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:40 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:23:40.952325 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Flavor limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:23:40.952767 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Image limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:23:40.953240 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Flavor pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:23:40.953656 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Image pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:23:40.954058 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:23:40.963148 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:40.963599 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:40.964432 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:40.964868 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:40.983416 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Getting quotas for project 2673840a4eb443a5814175271c259f76. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:23:40.989648 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Getting quotas for user d2acf16131e2442ebe76e681152a4dae and project 2673840a4eb443a5814175271c259f76. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:23:41.002142 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Going to run 1 instances... {{(pid=107499) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:23:41.004756 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107499) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:23:41.052388 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9ae7c2c3-a2bf-44aa-b0f0-759f656fe136 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.812287 Jul 22 22:23:41.053340 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 641/1259] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:23:40 2021] POST /compute/v2.1/servers => generated 382 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:23:41.065165 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e4226d4e-875d-4b7a-895a-d93c99e4f773 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:41.065890 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e4226d4e-875d-4b7a-895a-d93c99e4f773 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:41.125800 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e4226d4e-875d-4b7a-895a-d93c99e4f773 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:41.133263 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e4226d4e-875d-4b7a-895a-d93c99e4f773 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1223 microversion: 2.1 time: 0.073785 Jul 22 22:23:41.134085 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 619/1260] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:41 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1223 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:41.823233 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8f4fb396-a270-4658-8b98-757696e14dde tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:41.823889 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8f4fb396-a270-4658-8b98-757696e14dde tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:41.830393 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f4fb396-a270-4658-8b98-757696e14dde tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:41.831264 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f4fb396-a270-4658-8b98-757696e14dde tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:41.832067 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f4fb396-a270-4658-8b98-757696e14dde tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:41.832534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f4fb396-a270-4658-8b98-757696e14dde tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:42.107180 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8f4fb396-a270-4658-8b98-757696e14dde tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:42.116646 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8f4fb396-a270-4658-8b98-757696e14dde tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1319 microversion: 2.1 time: 0.297500 Jul 22 22:23:42.117182 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 642/1261] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:41 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:42.150297 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ab51c2ac-f855-4714-8a19-3c16b7108364 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:42.150921 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ab51c2ac-f855-4714-8a19-3c16b7108364 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:42.157152 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab51c2ac-f855-4714-8a19-3c16b7108364 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:42.157621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab51c2ac-f855-4714-8a19-3c16b7108364 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:42.159644 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab51c2ac-f855-4714-8a19-3c16b7108364 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:42.159644 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ab51c2ac-f855-4714-8a19-3c16b7108364 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:42.247177 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ab51c2ac-f855-4714-8a19-3c16b7108364 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:42.249188 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-933beaa3-27db-4243-ab61-fa6b522938dd req-20593591-3c2d-4a48-bf05-6c0bccd6e8eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2652b613-8089-49cb-80d9-7a78e29396fd", "tag": "c3b6ef37-f729-4e1a-b86f-79193fd501cb"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:42.251164 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:23:42.251164 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:23:42.261492 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-933beaa3-27db-4243-ab61-fa6b522938dd req-20593591-3c2d-4a48-bf05-6c0bccd6e8eb service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:42.262723 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-933beaa3-27db-4243-ab61-fa6b522938dd req-20593591-3c2d-4a48-bf05-6c0bccd6e8eb service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:42.276223 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ab51c2ac-f855-4714-8a19-3c16b7108364 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1275 microversion: 2.1 time: 0.129459 Jul 22 22:23:42.286534 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-933beaa3-27db-4243-ab61-fa6b522938dd req-20593591-3c2d-4a48-bf05-6c0bccd6e8eb service nova] Creating event network-changed:c3b6ef37-f729-4e1a-b86f-79193fd501cb for instance 2652b613-8089-49cb-80d9-7a78e29396fd on hv-cinder-80186 Jul 22 22:23:42.289095 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 620/1262] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:42 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1275 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:42.301425 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-933beaa3-27db-4243-ab61-fa6b522938dd req-20593591-3c2d-4a48-bf05-6c0bccd6e8eb service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056897 Jul 22 22:23:42.302166 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 643/1263] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:23:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:23:43.135632 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d7818ed3-82d4-40f0-934c-ff90341a2d57 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:43.136672 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d7818ed3-82d4-40f0-934c-ff90341a2d57 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:43.143904 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7818ed3-82d4-40f0-934c-ff90341a2d57 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:43.144390 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7818ed3-82d4-40f0-934c-ff90341a2d57 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:43.145185 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7818ed3-82d4-40f0-934c-ff90341a2d57 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:43.145621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d7818ed3-82d4-40f0-934c-ff90341a2d57 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:43.311978 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2ae42a56-91ae-4a57-a42f-ae0fe4724b09 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:43.315168 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2ae42a56-91ae-4a57-a42f-ae0fe4724b09 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:43.324666 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2ae42a56-91ae-4a57-a42f-ae0fe4724b09 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:43.325270 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2ae42a56-91ae-4a57-a42f-ae0fe4724b09 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:43.327137 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2ae42a56-91ae-4a57-a42f-ae0fe4724b09 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:43.327654 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2ae42a56-91ae-4a57-a42f-ae0fe4724b09 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:43.382672 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d7818ed3-82d4-40f0-934c-ff90341a2d57 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:43.394208 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d7818ed3-82d4-40f0-934c-ff90341a2d57 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1319 microversion: 2.1 time: 0.263337 Jul 22 22:23:43.395103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 621/1264] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:43 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:43.609416 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2ae42a56-91ae-4a57-a42f-ae0fe4724b09 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:43.622207 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2ae42a56-91ae-4a57-a42f-ae0fe4724b09 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1323 microversion: 2.1 time: 0.318371 Jul 22 22:23:43.622973 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 644/1265] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:43 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1323 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:43.980034 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-8e5218ce-a0b6-4efb-86de-b76566e49004 req-5e3962c8-a726-4934-84ba-606e5d13821a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d", "tag": "22196916-2c91-47c4-b9b7-b9f5be186a36"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:43.981728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:23:43.981728 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:23:43.990775 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-8e5218ce-a0b6-4efb-86de-b76566e49004 req-5e3962c8-a726-4934-84ba-606e5d13821a service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:43.991019 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-8e5218ce-a0b6-4efb-86de-b76566e49004 req-5e3962c8-a726-4934-84ba-606e5d13821a service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:44.005684 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-8e5218ce-a0b6-4efb-86de-b76566e49004 req-5e3962c8-a726-4934-84ba-606e5d13821a service nova] Creating event network-changed:22196916-2c91-47c4-b9b7-b9f5be186a36 for instance c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d on hv-cinder-80186 Jul 22 22:23:44.010796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-8e5218ce-a0b6-4efb-86de-b76566e49004 req-5e3962c8-a726-4934-84ba-606e5d13821a service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034393 Jul 22 22:23:44.011439 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 622/1266] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:23:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:44.411664 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ff8dbf16-4905-4a6c-be97-d45bb07f21bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:44.412335 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ff8dbf16-4905-4a6c-be97-d45bb07f21bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:44.418228 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff8dbf16-4905-4a6c-be97-d45bb07f21bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:44.418732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff8dbf16-4905-4a6c-be97-d45bb07f21bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:44.419573 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff8dbf16-4905-4a6c-be97-d45bb07f21bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:44.419898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff8dbf16-4905-4a6c-be97-d45bb07f21bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:44.569782 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ff8dbf16-4905-4a6c-be97-d45bb07f21bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:44.577415 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ff8dbf16-4905-4a6c-be97-d45bb07f21bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1319 microversion: 2.1 time: 0.170342 Jul 22 22:23:44.577986 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 645/1267] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:44 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:44.640464 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e20e7937-a3c1-49a7-a8e6-c84610e87141 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:44.641172 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e20e7937-a3c1-49a7-a8e6-c84610e87141 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:44.648372 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e20e7937-a3c1-49a7-a8e6-c84610e87141 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:44.648824 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e20e7937-a3c1-49a7-a8e6-c84610e87141 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:44.649609 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e20e7937-a3c1-49a7-a8e6-c84610e87141 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:44.650061 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e20e7937-a3c1-49a7-a8e6-c84610e87141 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:44.910756 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-e20e7937-a3c1-49a7-a8e6-c84610e87141 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:44.918496 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e20e7937-a3c1-49a7-a8e6-c84610e87141 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1323 microversion: 2.1 time: 0.282052 Jul 22 22:23:44.919074 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 623/1268] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:44 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1323 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:45.594239 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6155a2c6-d4fa-4b29-a26e-269632efdbe3 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:45.594840 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6155a2c6-d4fa-4b29-a26e-269632efdbe3 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:45.601351 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6155a2c6-d4fa-4b29-a26e-269632efdbe3 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:45.601794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6155a2c6-d4fa-4b29-a26e-269632efdbe3 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:45.602554 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6155a2c6-d4fa-4b29-a26e-269632efdbe3 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:45.602984 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6155a2c6-d4fa-4b29-a26e-269632efdbe3 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:45.745274 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6155a2c6-d4fa-4b29-a26e-269632efdbe3 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:45.753184 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6155a2c6-d4fa-4b29-a26e-269632efdbe3 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1319 microversion: 2.1 time: 0.162244 Jul 22 22:23:45.753912 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 646/1269] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:45 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:45.936504 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0a607a12-6339-46dc-a093-6ce7368870ab tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:45.937118 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0a607a12-6339-46dc-a093-6ce7368870ab tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:45.943405 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a607a12-6339-46dc-a093-6ce7368870ab tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:45.943861 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a607a12-6339-46dc-a093-6ce7368870ab tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:45.944699 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a607a12-6339-46dc-a093-6ce7368870ab tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:45.945142 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0a607a12-6339-46dc-a093-6ce7368870ab tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:46.095221 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0a607a12-6339-46dc-a093-6ce7368870ab tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:46.105198 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0a607a12-6339-46dc-a093-6ce7368870ab tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1323 microversion: 2.1 time: 0.172447 Jul 22 22:23:46.105793 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 624/1270] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:45 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1323 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:46.770950 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6a5bc470-ca04-45aa-a722-76879887a226 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:46.771571 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6a5bc470-ca04-45aa-a722-76879887a226 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:46.778039 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6a5bc470-ca04-45aa-a722-76879887a226 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:46.778476 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6a5bc470-ca04-45aa-a722-76879887a226 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:46.779257 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6a5bc470-ca04-45aa-a722-76879887a226 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:46.779713 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6a5bc470-ca04-45aa-a722-76879887a226 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:46.925813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6a5bc470-ca04-45aa-a722-76879887a226 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:46.934303 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6a5bc470-ca04-45aa-a722-76879887a226 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1319 microversion: 2.1 time: 0.167579 Jul 22 22:23:46.934968 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 647/1271] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:46 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:47.123429 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-5bdb9908-47f3-443c-8152-ceaf9b28a109 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:47.124045 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-5bdb9908-47f3-443c-8152-ceaf9b28a109 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:47.131226 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5bdb9908-47f3-443c-8152-ceaf9b28a109 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:47.131707 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5bdb9908-47f3-443c-8152-ceaf9b28a109 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:47.132520 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5bdb9908-47f3-443c-8152-ceaf9b28a109 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:47.132959 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-5bdb9908-47f3-443c-8152-ceaf9b28a109 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:47.282650 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-5bdb9908-47f3-443c-8152-ceaf9b28a109 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:47.290906 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-5bdb9908-47f3-443c-8152-ceaf9b28a109 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1323 microversion: 2.1 time: 0.171078 Jul 22 22:23:47.291478 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 625/1272] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:47 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1323 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:47.952535 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9774ccab-69ab-472b-98d0-c5cbb189db88 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:47.953097 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9774ccab-69ab-472b-98d0-c5cbb189db88 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:47.964888 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9774ccab-69ab-472b-98d0-c5cbb189db88 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:47.965333 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9774ccab-69ab-472b-98d0-c5cbb189db88 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:47.966131 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9774ccab-69ab-472b-98d0-c5cbb189db88 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:47.966572 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9774ccab-69ab-472b-98d0-c5cbb189db88 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:48.139168 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9774ccab-69ab-472b-98d0-c5cbb189db88 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:48.148758 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9774ccab-69ab-472b-98d0-c5cbb189db88 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1319 microversion: 2.1 time: 0.199914 Jul 22 22:23:48.149640 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 648/1273] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:47 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:48.308593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0dd56ec8-4a5f-4529-bb9c-448d8ea2d482 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:48.309471 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0dd56ec8-4a5f-4529-bb9c-448d8ea2d482 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:48.315939 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dd56ec8-4a5f-4529-bb9c-448d8ea2d482 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:48.316428 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dd56ec8-4a5f-4529-bb9c-448d8ea2d482 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:48.317256 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dd56ec8-4a5f-4529-bb9c-448d8ea2d482 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:48.317688 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0dd56ec8-4a5f-4529-bb9c-448d8ea2d482 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:48.476062 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0dd56ec8-4a5f-4529-bb9c-448d8ea2d482 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:48.483543 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0dd56ec8-4a5f-4529-bb9c-448d8ea2d482 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1323 microversion: 2.1 time: 0.178647 Jul 22 22:23:48.484102 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 626/1274] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:48 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:49.170786 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fd848ea6-3b09-4b42-9133-d0ff079824eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:49.171388 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-fd848ea6-3b09-4b42-9133-d0ff079824eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:49.177934 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fd848ea6-3b09-4b42-9133-d0ff079824eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:49.178366 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fd848ea6-3b09-4b42-9133-d0ff079824eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:49.179132 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fd848ea6-3b09-4b42-9133-d0ff079824eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:49.179550 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-fd848ea6-3b09-4b42-9133-d0ff079824eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:49.331597 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-fd848ea6-3b09-4b42-9133-d0ff079824eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:49.339200 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fd848ea6-3b09-4b42-9133-d0ff079824eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1319 microversion: 2.1 time: 0.172179 Jul 22 22:23:49.339778 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 649/1275] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:49 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:49.500483 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-515ed299-5f3f-46f3-ad56-1e7fe4e89c23 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:49.501219 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-515ed299-5f3f-46f3-ad56-1e7fe4e89c23 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:49.507852 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-515ed299-5f3f-46f3-ad56-1e7fe4e89c23 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:49.508310 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-515ed299-5f3f-46f3-ad56-1e7fe4e89c23 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:49.509083 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-515ed299-5f3f-46f3-ad56-1e7fe4e89c23 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:49.509509 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-515ed299-5f3f-46f3-ad56-1e7fe4e89c23 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:49.649069 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-515ed299-5f3f-46f3-ad56-1e7fe4e89c23 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:49.657117 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-515ed299-5f3f-46f3-ad56-1e7fe4e89c23 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1323 microversion: 2.1 time: 0.160626 Jul 22 22:23:49.657693 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 627/1276] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:49 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1323 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:50.356096 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c253f909-417f-468e-82f8-ae6ff824ccd4 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:50.356794 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c253f909-417f-468e-82f8-ae6ff824ccd4 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:50.364237 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c253f909-417f-468e-82f8-ae6ff824ccd4 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:50.364701 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c253f909-417f-468e-82f8-ae6ff824ccd4 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:50.365470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c253f909-417f-468e-82f8-ae6ff824ccd4 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:50.365895 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c253f909-417f-468e-82f8-ae6ff824ccd4 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:50.509492 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c253f909-417f-468e-82f8-ae6ff824ccd4 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:50.516966 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c253f909-417f-468e-82f8-ae6ff824ccd4 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1319 microversion: 2.1 time: 0.164563 Jul 22 22:23:50.517556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 650/1277] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:50 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:50.675194 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-8955a2dd-f29d-4583-9dc8-a2b93ea7b83b tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:50.675815 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-8955a2dd-f29d-4583-9dc8-a2b93ea7b83b tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:50.681787 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8955a2dd-f29d-4583-9dc8-a2b93ea7b83b tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:50.682232 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8955a2dd-f29d-4583-9dc8-a2b93ea7b83b tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:50.683000 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8955a2dd-f29d-4583-9dc8-a2b93ea7b83b tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:50.683433 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-8955a2dd-f29d-4583-9dc8-a2b93ea7b83b tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:50.821264 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-8955a2dd-f29d-4583-9dc8-a2b93ea7b83b tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:50.828899 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-8955a2dd-f29d-4583-9dc8-a2b93ea7b83b tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1323 microversion: 2.1 time: 0.158291 Jul 22 22:23:50.829462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 628/1278] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:50 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:51.447012 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-9fe37a03-efe7-41c6-8e63-fc4cee5a5249 req-26118be1-97e2-443c-90db-7732d8904d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2652b613-8089-49cb-80d9-7a78e29396fd", "name": "network-vif-plugged", "status": "completed", "tag": "c3b6ef37-f729-4e1a-b86f-79193fd501cb"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:51.448562 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:23:51.448562 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:23:51.457403 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-9fe37a03-efe7-41c6-8e63-fc4cee5a5249 req-26118be1-97e2-443c-90db-7732d8904d2c service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:51.457848 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-9fe37a03-efe7-41c6-8e63-fc4cee5a5249 req-26118be1-97e2-443c-90db-7732d8904d2c service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:51.469628 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-9fe37a03-efe7-41c6-8e63-fc4cee5a5249 req-26118be1-97e2-443c-90db-7732d8904d2c service nova] Creating event network-vif-plugged:c3b6ef37-f729-4e1a-b86f-79193fd501cb for instance 2652b613-8089-49cb-80d9-7a78e29396fd on hv-cinder-80186 Jul 22 22:23:51.475268 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-9fe37a03-efe7-41c6-8e63-fc4cee5a5249 req-26118be1-97e2-443c-90db-7732d8904d2c service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032405 Jul 22 22:23:51.475863 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 651/1279] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:23:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:51.534744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-84590a8b-9eab-49c0-9d11-144464ec0cab tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:51.535463 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-84590a8b-9eab-49c0-9d11-144464ec0cab tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:51.542540 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-84590a8b-9eab-49c0-9d11-144464ec0cab tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:51.542654 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-84590a8b-9eab-49c0-9d11-144464ec0cab tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:51.543410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-84590a8b-9eab-49c0-9d11-144464ec0cab tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:51.543846 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-84590a8b-9eab-49c0-9d11-144464ec0cab tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:51.746276 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-84590a8b-9eab-49c0-9d11-144464ec0cab tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:51.757356 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-84590a8b-9eab-49c0-9d11-144464ec0cab tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1319 microversion: 2.1 time: 0.226842 Jul 22 22:23:51.760147 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 629/1280] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:51 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:51.846924 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3b6e0dd3-de4d-47dd-8817-7afebfd9cbc8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:51.849648 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3b6e0dd3-de4d-47dd-8817-7afebfd9cbc8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:51.863333 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b6e0dd3-de4d-47dd-8817-7afebfd9cbc8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:51.864136 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b6e0dd3-de4d-47dd-8817-7afebfd9cbc8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:51.865551 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b6e0dd3-de4d-47dd-8817-7afebfd9cbc8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:51.866342 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3b6e0dd3-de4d-47dd-8817-7afebfd9cbc8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:52.025046 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3b6e0dd3-de4d-47dd-8817-7afebfd9cbc8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:52.032572 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3b6e0dd3-de4d-47dd-8817-7afebfd9cbc8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1323 microversion: 2.1 time: 0.189846 Jul 22 22:23:52.033749 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 652/1281] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:51 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:52.781765 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fff66c7b-4e39-4128-9ece-80279891272c tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:52.782367 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fff66c7b-4e39-4128-9ece-80279891272c tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:52.790166 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fff66c7b-4e39-4128-9ece-80279891272c tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:52.790601 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fff66c7b-4e39-4128-9ece-80279891272c tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:52.791372 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fff66c7b-4e39-4128-9ece-80279891272c tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:52.791802 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fff66c7b-4e39-4128-9ece-80279891272c tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:52.936826 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fff66c7b-4e39-4128-9ece-80279891272c tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:52.945025 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fff66c7b-4e39-4128-9ece-80279891272c tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1319 microversion: 2.1 time: 0.167050 Jul 22 22:23:52.945596 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 630/1282] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:52 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:53.049291 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1267c5eb-7eb7-493d-a8ff-27e5a7fc15a8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:53.049863 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1267c5eb-7eb7-493d-a8ff-27e5a7fc15a8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:53.056047 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1267c5eb-7eb7-493d-a8ff-27e5a7fc15a8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:53.056521 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1267c5eb-7eb7-493d-a8ff-27e5a7fc15a8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:53.057318 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1267c5eb-7eb7-493d-a8ff-27e5a7fc15a8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:53.057751 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1267c5eb-7eb7-493d-a8ff-27e5a7fc15a8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:53.217446 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1267c5eb-7eb7-493d-a8ff-27e5a7fc15a8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:53.225848 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1267c5eb-7eb7-493d-a8ff-27e5a7fc15a8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1323 microversion: 2.1 time: 0.180196 Jul 22 22:23:53.226438 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 653/1283] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:53 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1323 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:23:53.509808 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-e6cc4e92-1107-4da3-a62d-1d15aab4bc85 req-6247e55e-d59c-4fa0-b01a-03af8d79d15f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d", "name": "network-vif-plugged", "status": "completed", "tag": "22196916-2c91-47c4-b9b7-b9f5be186a36"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:53.511377 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:23:53.511377 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:23:53.518151 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-e6cc4e92-1107-4da3-a62d-1d15aab4bc85 req-6247e55e-d59c-4fa0-b01a-03af8d79d15f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:53.518583 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-e6cc4e92-1107-4da3-a62d-1d15aab4bc85 req-6247e55e-d59c-4fa0-b01a-03af8d79d15f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:53.530046 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-e6cc4e92-1107-4da3-a62d-1d15aab4bc85 req-6247e55e-d59c-4fa0-b01a-03af8d79d15f service nova] Creating event network-vif-plugged:22196916-2c91-47c4-b9b7-b9f5be186a36 for instance c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d on hv-cinder-80186 Jul 22 22:23:53.534968 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-e6cc4e92-1107-4da3-a62d-1d15aab4bc85 req-6247e55e-d59c-4fa0-b01a-03af8d79d15f service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028982 Jul 22 22:23:53.535583 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 631/1284] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:23:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:53.962945 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7a37fcdc-80cf-4d83-9448-9c8867e1be43 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:53.963559 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7a37fcdc-80cf-4d83-9448-9c8867e1be43 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:53.969549 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7a37fcdc-80cf-4d83-9448-9c8867e1be43 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:53.969946 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7a37fcdc-80cf-4d83-9448-9c8867e1be43 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:53.970721 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7a37fcdc-80cf-4d83-9448-9c8867e1be43 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:53.971155 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7a37fcdc-80cf-4d83-9448-9c8867e1be43 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:54.116851 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7a37fcdc-80cf-4d83-9448-9c8867e1be43 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:54.125025 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7a37fcdc-80cf-4d83-9448-9c8867e1be43 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1469 microversion: 2.1 time: 0.165705 Jul 22 22:23:54.125592 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 654/1285] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:53 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:54.165523 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-20ddb220-d1f2-4282-9e4f-2578039ec4eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:54.166286 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-20ddb220-d1f2-4282-9e4f-2578039ec4eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:54.172483 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-20ddb220-d1f2-4282-9e4f-2578039ec4eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:54.172931 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-20ddb220-d1f2-4282-9e4f-2578039ec4eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:54.173996 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-20ddb220-d1f2-4282-9e4f-2578039ec4eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:54.174311 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-20ddb220-d1f2-4282-9e4f-2578039ec4eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:54.200482 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-20ddb220-d1f2-4282-9e4f-2578039ec4eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:23:54.246323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-593750b6-e2a7-4a8d-8f2c-dedab2f1277c tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:54.246924 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-593750b6-e2a7-4a8d-8f2c-dedab2f1277c tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:54.252867 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-593750b6-e2a7-4a8d-8f2c-dedab2f1277c tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:54.253305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-593750b6-e2a7-4a8d-8f2c-dedab2f1277c tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:54.254659 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-593750b6-e2a7-4a8d-8f2c-dedab2f1277c tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:54.255090 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-593750b6-e2a7-4a8d-8f2c-dedab2f1277c tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:54.285569 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-20ddb220-d1f2-4282-9e4f-2578039ec4eb tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "DELETE /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 204 len: 0 microversion: 2.1 time: 0.123961 Jul 22 22:23:54.286248 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 632/1286] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:23:54 2021] DELETE /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:23:54.296101 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0194decd-548b-4715-8b4c-f3efdd4b1c25 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:54.297127 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0194decd-548b-4715-8b4c-f3efdd4b1c25 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:54.303459 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0194decd-548b-4715-8b4c-f3efdd4b1c25 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:54.303905 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0194decd-548b-4715-8b4c-f3efdd4b1c25 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:54.304712 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0194decd-548b-4715-8b4c-f3efdd4b1c25 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:54.305140 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0194decd-548b-4715-8b4c-f3efdd4b1c25 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:54.413973 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-593750b6-e2a7-4a8d-8f2c-dedab2f1277c tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:54.421318 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-593750b6-e2a7-4a8d-8f2c-dedab2f1277c tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1323 microversion: 2.1 time: 0.178584 Jul 22 22:23:54.421885 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 655/1287] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:54 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:23:54.451385 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0194decd-548b-4715-8b4c-f3efdd4b1c25 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:54.459584 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0194decd-548b-4715-8b4c-f3efdd4b1c25 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1475 microversion: 2.1 time: 0.168839 Jul 22 22:23:54.460140 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 633/1288] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:54 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1475 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:55.438581 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-076b788e-ee72-4a44-b1ec-1a6a8cf4c980 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:55.439136 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-076b788e-ee72-4a44-b1ec-1a6a8cf4c980 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:55.445797 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-076b788e-ee72-4a44-b1ec-1a6a8cf4c980 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:55.446524 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-076b788e-ee72-4a44-b1ec-1a6a8cf4c980 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:55.447312 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-076b788e-ee72-4a44-b1ec-1a6a8cf4c980 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:55.447752 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-076b788e-ee72-4a44-b1ec-1a6a8cf4c980 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:55.477749 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-43504f05-8a92-4635-a464-26197f80e120 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:55.478362 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-43504f05-8a92-4635-a464-26197f80e120 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:55.484236 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-43504f05-8a92-4635-a464-26197f80e120 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:55.484708 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-43504f05-8a92-4635-a464-26197f80e120 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:55.485473 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-43504f05-8a92-4635-a464-26197f80e120 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:55.485903 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-43504f05-8a92-4635-a464-26197f80e120 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:55.590588 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-076b788e-ee72-4a44-b1ec-1a6a8cf4c980 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:55.598347 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-076b788e-ee72-4a44-b1ec-1a6a8cf4c980 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1323 microversion: 2.1 time: 0.163336 Jul 22 22:23:55.599009 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 656/1289] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:55 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:55.624268 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-43504f05-8a92-4635-a464-26197f80e120 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:55.632234 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-43504f05-8a92-4635-a464-26197f80e120 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1475 microversion: 2.1 time: 0.158276 Jul 22 22:23:55.632822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 634/1290] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:55 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1475 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:56.615193 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-dec0fb15-11f7-4289-a79e-f74c4f4f4d6e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:56.616106 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-dec0fb15-11f7-4289-a79e-f74c4f4f4d6e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:56.622347 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dec0fb15-11f7-4289-a79e-f74c4f4f4d6e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:56.622802 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dec0fb15-11f7-4289-a79e-f74c4f4f4d6e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:56.623569 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dec0fb15-11f7-4289-a79e-f74c4f4f4d6e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:56.624003 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-dec0fb15-11f7-4289-a79e-f74c4f4f4d6e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:56.650294 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-11477639-906e-4def-b7e5-4039501ca620 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:56.651100 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-11477639-906e-4def-b7e5-4039501ca620 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:56.659881 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-11477639-906e-4def-b7e5-4039501ca620 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:56.660976 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-11477639-906e-4def-b7e5-4039501ca620 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:56.662352 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-11477639-906e-4def-b7e5-4039501ca620 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:56.663114 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-11477639-906e-4def-b7e5-4039501ca620 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:56.780599 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-dec0fb15-11f7-4289-a79e-f74c4f4f4d6e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:56.787862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-dec0fb15-11f7-4289-a79e-f74c4f4f4d6e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1512 microversion: 2.1 time: 0.176326 Jul 22 22:23:56.788492 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 657/1291] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:56 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1512 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:23:56.865330 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-11477639-906e-4def-b7e5-4039501ca620 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:56.873346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-11477639-906e-4def-b7e5-4039501ca620 tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1475 microversion: 2.1 time: 0.226993 Jul 22 22:23:56.874100 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 635/1292] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:56 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1475 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:23:57.306206 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-c6ee3d5c-20c6-4976-b863-5172cb101cf3 req-c38ec97d-a9a2-4418-ba3e-13251944f10d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2652b613-8089-49cb-80d9-7a78e29396fd", "name": "network-vif-deleted", "tag": "c3b6ef37-f729-4e1a-b86f-79193fd501cb"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:23:57.308494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:23:57.308494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:23:57.318465 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-c6ee3d5c-20c6-4976-b863-5172cb101cf3 req-c38ec97d-a9a2-4418-ba3e-13251944f10d service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:57.318909 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-c6ee3d5c-20c6-4976-b863-5172cb101cf3 req-c38ec97d-a9a2-4418-ba3e-13251944f10d service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:57.332688 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-c6ee3d5c-20c6-4976-b863-5172cb101cf3 req-c38ec97d-a9a2-4418-ba3e-13251944f10d service nova] Creating event network-vif-deleted:c3b6ef37-f729-4e1a-b86f-79193fd501cb for instance 2652b613-8089-49cb-80d9-7a78e29396fd on hv-cinder-80186 Jul 22 22:23:57.338449 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-c6ee3d5c-20c6-4976-b863-5172cb101cf3 req-c38ec97d-a9a2-4418-ba3e-13251944f10d service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036008 Jul 22 22:23:57.340441 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 658/1293] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:23:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:23:57.890809 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7ca8b081-f043-4c57-98ec-06f3cfc295bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:57.891420 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7ca8b081-f043-4c57-98ec-06f3cfc295bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:57.897710 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7ca8b081-f043-4c57-98ec-06f3cfc295bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:57.898149 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7ca8b081-f043-4c57-98ec-06f3cfc295bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:57.898906 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7ca8b081-f043-4c57-98ec-06f3cfc295bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:57.899329 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7ca8b081-f043-4c57-98ec-06f3cfc295bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:57.933178 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7ca8b081-f043-4c57-98ec-06f3cfc295bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:57.933616 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7ca8b081-f043-4c57-98ec-06f3cfc295bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:57.934062 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.objects.instance [None req-7ca8b081-f043-4c57-98ec-06f3cfc295bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lazy-loading 'fault' on Instance uuid 2652b613-8089-49cb-80d9-7a78e29396fd {{(pid=107498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:23:57.984782 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7ca8b081-f043-4c57-98ec-06f3cfc295bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa4ef28b34bd4acd87afbd52fdcbf2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f4ec5bb58cf47fc8dbbcacfdaa282b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:23:57.994505 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7ca8b081-f043-4c57-98ec-06f3cfc295bf tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 200 len: 1309 microversion: 2.1 time: 0.107244 Jul 22 22:23:57.995091 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 636/1294] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:57 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:23:59.011581 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-16e6973c-43ab-42de-9d63-dfaa2b72345a tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:23:59.012264 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-16e6973c-43ab-42de-9d63-dfaa2b72345a tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] [instance: 2652b613-8089-49cb-80d9-7a78e29396fd] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:23:59.018429 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-16e6973c-43ab-42de-9d63-dfaa2b72345a tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:59.018864 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-16e6973c-43ab-42de-9d63-dfaa2b72345a tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:59.019837 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-16e6973c-43ab-42de-9d63-dfaa2b72345a tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:23:59.020413 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-16e6973c-43ab-42de-9d63-dfaa2b72345a tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:23:59.033121 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-16e6973c-43ab-42de-9d63-dfaa2b72345a tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] HTTP exception thrown: Instance 2652b613-8089-49cb-80d9-7a78e29396fd could not be found. Jul 22 22:23:59.033689 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-16e6973c-43ab-42de-9d63-dfaa2b72345a tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] Returning 404 to user: Instance 2652b613-8089-49cb-80d9-7a78e29396fd could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:23:59.034597 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-16e6973c-43ab-42de-9d63-dfaa2b72345a tempest-VolumesNegativeTest-1250642059 tempest-VolumesNegativeTest-1250642059-project] 10.222.0.110 "GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd" status: 404 len: 111 microversion: 2.1 time: 0.027070 Jul 22 22:23:59.035842 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 659/1295] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:23:59 2021] GET /compute/v2.1/servers/2652b613-8089-49cb-80d9-7a78e29396fd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:24:18.359048 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e15dceb4-013f-4387-9cfb-0e8d21a09337 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d2aca20-943b-4cbd-92c0-13ab86b870da", "device": "/dev/sdb"}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:24:18.360864 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e15dceb4-013f-4387-9cfb-0e8d21a09337 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:24:18.367103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e15dceb4-013f-4387-9cfb-0e8d21a09337 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:18.367551 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e15dceb4-013f-4387-9cfb-0e8d21a09337 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:18.368350 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e15dceb4-013f-4387-9cfb-0e8d21a09337 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:18.368780 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e15dceb4-013f-4387-9cfb-0e8d21a09337 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:18.642449 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e15dceb4-013f-4387-9cfb-0e8d21a09337 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "POST /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287718 Jul 22 22:24:18.643058 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 637/1296] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:24:18 2021] POST /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:24:43.306607 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d64e18a9-e0e3-4833-8135-c3297494c0bd tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:24:43.307188 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d64e18a9-e0e3-4833-8135-c3297494c0bd tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:24:43.313537 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d64e18a9-e0e3-4833-8135-c3297494c0bd tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:43.314071 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d64e18a9-e0e3-4833-8135-c3297494c0bd tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:43.315800 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d64e18a9-e0e3-4833-8135-c3297494c0bd tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:43.316608 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d64e18a9-e0e3-4833-8135-c3297494c0bd tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:43.405494 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-d64e18a9-e0e3-4833-8135-c3297494c0bd tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lazy-loading 'services' on Instance uuid c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:24:43.475858 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d64e18a9-e0e3-4833-8135-c3297494c0bd tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "DELETE /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d/os-volume_attachments/3d2aca20-943b-4cbd-92c0-13ab86b870da" status: 202 len: 0 microversion: 2.1 time: 0.172996 Jul 22 22:24:43.476480 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 660/1297] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:24:43 2021] DELETE /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d/os-volume_attachments/3d2aca20-943b-4cbd-92c0-13ab86b870da => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:24:45.653689 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d2fe021a-b835-4a5b-836e-105de3480f76 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:24:45.654306 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d2fe021a-b835-4a5b-836e-105de3480f76 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:24:45.661496 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d2fe021a-b835-4a5b-836e-105de3480f76 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:45.661941 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d2fe021a-b835-4a5b-836e-105de3480f76 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:45.662722 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d2fe021a-b835-4a5b-836e-105de3480f76 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:45.663155 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d2fe021a-b835-4a5b-836e-105de3480f76 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:45.690514 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d2fe021a-b835-4a5b-836e-105de3480f76 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:24:45.770500 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d2fe021a-b835-4a5b-836e-105de3480f76 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "DELETE /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 204 len: 0 microversion: 2.1 time: 0.120428 Jul 22 22:24:45.770500 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 638/1298] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:24:45 2021] DELETE /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:24:45.781040 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3a6515b6-9eb0-4c23-a486-9f567969c45a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:24:45.781766 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3a6515b6-9eb0-4c23-a486-9f567969c45a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:24:45.789052 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a6515b6-9eb0-4c23-a486-9f567969c45a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:45.789524 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a6515b6-9eb0-4c23-a486-9f567969c45a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:45.790280 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a6515b6-9eb0-4c23-a486-9f567969c45a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:45.790705 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3a6515b6-9eb0-4c23-a486-9f567969c45a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:45.929731 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3a6515b6-9eb0-4c23-a486-9f567969c45a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:24:45.937166 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3a6515b6-9eb0-4c23-a486-9f567969c45a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1518 microversion: 2.1 time: 0.160826 Jul 22 22:24:45.937716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 661/1299] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:24:45 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:24:46.955968 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-fba51dd1-ffa2-40ab-87c5-eb1bcc1233c9 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:24:46.956653 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-fba51dd1-ffa2-40ab-87c5-eb1bcc1233c9 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:24:46.962683 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fba51dd1-ffa2-40ab-87c5-eb1bcc1233c9 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:46.963416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fba51dd1-ffa2-40ab-87c5-eb1bcc1233c9 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:46.964586 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fba51dd1-ffa2-40ab-87c5-eb1bcc1233c9 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:46.965026 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-fba51dd1-ffa2-40ab-87c5-eb1bcc1233c9 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:47.123110 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-fba51dd1-ffa2-40ab-87c5-eb1bcc1233c9 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:24:47.131541 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-fba51dd1-ffa2-40ab-87c5-eb1bcc1233c9 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1518 microversion: 2.1 time: 0.180213 Jul 22 22:24:47.132119 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 639/1300] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:24:46 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:24:48.148509 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-66afc63f-0649-47f1-9338-a3bcb8069c3a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:24:48.149217 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-66afc63f-0649-47f1-9338-a3bcb8069c3a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:24:48.155819 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-66afc63f-0649-47f1-9338-a3bcb8069c3a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:48.156431 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-66afc63f-0649-47f1-9338-a3bcb8069c3a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:48.157206 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-66afc63f-0649-47f1-9338-a3bcb8069c3a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:48.157637 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-66afc63f-0649-47f1-9338-a3bcb8069c3a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:48.330749 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-66afc63f-0649-47f1-9338-a3bcb8069c3a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:24:48.339714 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-66afc63f-0649-47f1-9338-a3bcb8069c3a tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1518 microversion: 2.1 time: 0.194782 Jul 22 22:24:48.340333 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 662/1301] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:24:48 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:24:49.204027 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-72be4e0b-cad5-4698-ad3c-0909478accd1 req-addf3a34-14f7-4ce3-8c4b-cf36207d0ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d", "name": "network-vif-deleted", "tag": "22196916-2c91-47c4-b9b7-b9f5be186a36"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:24:49.206093 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:24:49.206093 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:24:49.213311 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-72be4e0b-cad5-4698-ad3c-0909478accd1 req-addf3a34-14f7-4ce3-8c4b-cf36207d0ba6 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:49.214148 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-72be4e0b-cad5-4698-ad3c-0909478accd1 req-addf3a34-14f7-4ce3-8c4b-cf36207d0ba6 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:49.226826 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-72be4e0b-cad5-4698-ad3c-0909478accd1 req-addf3a34-14f7-4ce3-8c4b-cf36207d0ba6 service nova] Creating event network-vif-deleted:22196916-2c91-47c4-b9b7-b9f5be186a36 for instance c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d on hv-cinder-80186 Jul 22 22:24:49.231468 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-72be4e0b-cad5-4698-ad3c-0909478accd1 req-addf3a34-14f7-4ce3-8c4b-cf36207d0ba6 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180575 Jul 22 22:24:49.232060 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 640/1302] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:24:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:24:49.358841 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7d887e18-dab4-4c6c-b017-38a1222bbc53 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:24:49.359455 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7d887e18-dab4-4c6c-b017-38a1222bbc53 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:24:49.366155 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d887e18-dab4-4c6c-b017-38a1222bbc53 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:49.366597 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d887e18-dab4-4c6c-b017-38a1222bbc53 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:49.367363 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d887e18-dab4-4c6c-b017-38a1222bbc53 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:49.367802 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d887e18-dab4-4c6c-b017-38a1222bbc53 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:49.398646 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d887e18-dab4-4c6c-b017-38a1222bbc53 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:49.399090 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7d887e18-dab4-4c6c-b017-38a1222bbc53 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:49.399533 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-7d887e18-dab4-4c6c-b017-38a1222bbc53 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lazy-loading 'fault' on Instance uuid c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:24:49.445660 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7d887e18-dab4-4c6c-b017-38a1222bbc53 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:24:49.453814 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7d887e18-dab4-4c6c-b017-38a1222bbc53 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 200 len: 1313 microversion: 2.1 time: 0.098570 Jul 22 22:24:49.454403 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 663/1303] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:24:49 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 1313 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:24:50.472417 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e1470822-2679-4dfa-bfdb-b8ae874a247f tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:24:50.473032 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-e1470822-2679-4dfa-bfdb-b8ae874a247f tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:24:50.479279 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e1470822-2679-4dfa-bfdb-b8ae874a247f tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:50.479731 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e1470822-2679-4dfa-bfdb-b8ae874a247f tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:50.480531 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e1470822-2679-4dfa-bfdb-b8ae874a247f tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:24:50.480972 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-e1470822-2679-4dfa-bfdb-b8ae874a247f tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:24:50.496937 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-e1470822-2679-4dfa-bfdb-b8ae874a247f tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] HTTP exception thrown: Instance c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d could not be found. Jul 22 22:24:50.497524 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-e1470822-2679-4dfa-bfdb-b8ae874a247f tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Returning 404 to user: Instance c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:24:50.498358 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-e1470822-2679-4dfa-bfdb-b8ae874a247f tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d" status: 404 len: 111 microversion: 2.1 time: 0.030135 Jul 22 22:24:50.498903 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 641/1304] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:24:50 2021] GET /compute/v2.1/servers/c827f4a1-c445-4ac0-b5ba-9f5c8adb0a6d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 22 22:25:00.346831 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1563545864", "imageRef": "1d860872-174a-4472-bcd4-30124f443275", "flavorRef": "452", "networks": [{"uuid": "cfece6d9-3805-4575-aed6-82a5dc944436"}]}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:25:00.399855 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.network.neutron [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] validate_networks() for [('cfece6d9-3805-4575-aed6-82a5dc944436', None, None, None)] {{(pid=107499) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:25:00.757827 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Flavor limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:25:00.758170 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Image limits 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:25:00.758733 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Flavor pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:25:00.759143 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Image pref 0:0:0 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:25:00.759551 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.virt.hardware [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107499) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:25:00.769010 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:00.769458 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:00.770266 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:00.770695 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:00.787938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Getting quotas for project 2673840a4eb443a5814175271c259f76. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:25:00.791870 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Getting quotas for user d2acf16131e2442ebe76e681152a4dae and project 2673840a4eb443a5814175271c259f76. Resources: {'cores', 'instances', 'ram'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:25:00.802712 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Going to run 1 instances... {{(pid=107499) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:25:00.805021 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1d860872-174a-4472-bcd4-30124f443275',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107499) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:25:00.853452 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e8f95f50-76e2-4b9c-9eeb-7586fd2ac43d tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 382 microversion: 2.1 time: 0.510920 Jul 22 22:25:00.854091 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 664/1305] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:25:00 2021] POST /compute/v2.1/servers => generated 382 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:25:00.864323 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-f39175e8-b233-42fb-a054-58971499a1d6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:00.864939 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-f39175e8-b233-42fb-a054-58971499a1d6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:00.933778 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-f39175e8-b233-42fb-a054-58971499a1d6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:00.939020 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-f39175e8-b233-42fb-a054-58971499a1d6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1223 microversion: 2.1 time: 0.078156 Jul 22 22:25:00.939914 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 642/1306] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:00 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1223 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:01.960618 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-a72c7402-8efe-4db8-a0d1-3d7d3b001c13 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:01.961790 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-a72c7402-8efe-4db8-a0d1-3d7d3b001c13 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:01.972658 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a72c7402-8efe-4db8-a0d1-3d7d3b001c13 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:01.973470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a72c7402-8efe-4db8-a0d1-3d7d3b001c13 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:01.974914 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a72c7402-8efe-4db8-a0d1-3d7d3b001c13 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:01.975640 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-a72c7402-8efe-4db8-a0d1-3d7d3b001c13 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:02.045893 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-a72c7402-8efe-4db8-a0d1-3d7d3b001c13 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:02.055449 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-a72c7402-8efe-4db8-a0d1-3d7d3b001c13 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1283 microversion: 2.1 time: 0.102351 Jul 22 22:25:02.056707 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 665/1307] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:01 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:03.074067 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0b95af7d-85a4-428b-8f82-d724de609046 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:03.075239 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0b95af7d-85a4-428b-8f82-d724de609046 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:03.082655 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b95af7d-85a4-428b-8f82-d724de609046 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:03.083093 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b95af7d-85a4-428b-8f82-d724de609046 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:03.083868 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b95af7d-85a4-428b-8f82-d724de609046 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:03.084322 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0b95af7d-85a4-428b-8f82-d724de609046 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:03.371617 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0b95af7d-85a4-428b-8f82-d724de609046 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:03.379671 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0b95af7d-85a4-428b-8f82-d724de609046 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1323 microversion: 2.1 time: 0.310383 Jul 22 22:25:03.380255 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 643/1308] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:03 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1323 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:03.523756 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-5289d7b5-eabc-46ff-83ab-c65d040216af req-66b7acac-ced3-43ba-919d-09a163f08828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86af1817-2d1f-4697-b8d9-2917e150eb65", "tag": "3d6d74dd-5944-43a7-92f4-cdb257d328d4"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:25:03.525384 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:25:03.525384 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:25:03.533409 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-5289d7b5-eabc-46ff-83ab-c65d040216af req-66b7acac-ced3-43ba-919d-09a163f08828 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:03.533845 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-5289d7b5-eabc-46ff-83ab-c65d040216af req-66b7acac-ced3-43ba-919d-09a163f08828 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:03.547112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-5289d7b5-eabc-46ff-83ab-c65d040216af req-66b7acac-ced3-43ba-919d-09a163f08828 service nova] Creating event network-changed:3d6d74dd-5944-43a7-92f4-cdb257d328d4 for instance 86af1817-2d1f-4697-b8d9-2917e150eb65 on hv-cinder-80186 Jul 22 22:25:03.552459 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-5289d7b5-eabc-46ff-83ab-c65d040216af req-66b7acac-ced3-43ba-919d-09a163f08828 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032338 Jul 22 22:25:03.553051 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 666/1309] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:25:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:25:04.397385 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-852bfe57-bd9f-442a-b58a-63ee8371739e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:04.397925 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-852bfe57-bd9f-442a-b58a-63ee8371739e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:04.403765 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-852bfe57-bd9f-442a-b58a-63ee8371739e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:04.404346 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-852bfe57-bd9f-442a-b58a-63ee8371739e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:04.405119 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-852bfe57-bd9f-442a-b58a-63ee8371739e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:04.405550 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-852bfe57-bd9f-442a-b58a-63ee8371739e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:04.623918 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-852bfe57-bd9f-442a-b58a-63ee8371739e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:04.632512 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-852bfe57-bd9f-442a-b58a-63ee8371739e tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1323 microversion: 2.1 time: 0.238887 Jul 22 22:25:04.633080 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 644/1310] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:04 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1323 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:05.650538 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-8f62443c-7cb2-4e2c-b66f-e8e0f3d61ba1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:05.651220 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-8f62443c-7cb2-4e2c-b66f-e8e0f3d61ba1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:05.657977 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f62443c-7cb2-4e2c-b66f-e8e0f3d61ba1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:05.658427 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f62443c-7cb2-4e2c-b66f-e8e0f3d61ba1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:05.659166 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f62443c-7cb2-4e2c-b66f-e8e0f3d61ba1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:05.659593 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-8f62443c-7cb2-4e2c-b66f-e8e0f3d61ba1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:05.795712 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-8f62443c-7cb2-4e2c-b66f-e8e0f3d61ba1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:05.803676 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-8f62443c-7cb2-4e2c-b66f-e8e0f3d61ba1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1323 microversion: 2.1 time: 0.157185 Jul 22 22:25:05.804261 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 667/1311] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:05 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:06.821669 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7047d4ab-2bbb-4b09-b74d-3fd399e4dee8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:06.822280 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7047d4ab-2bbb-4b09-b74d-3fd399e4dee8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:06.829443 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7047d4ab-2bbb-4b09-b74d-3fd399e4dee8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:06.829893 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7047d4ab-2bbb-4b09-b74d-3fd399e4dee8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:06.830684 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7047d4ab-2bbb-4b09-b74d-3fd399e4dee8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:06.831108 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7047d4ab-2bbb-4b09-b74d-3fd399e4dee8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:06.968822 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7047d4ab-2bbb-4b09-b74d-3fd399e4dee8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:06.976750 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7047d4ab-2bbb-4b09-b74d-3fd399e4dee8 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1323 microversion: 2.1 time: 0.159057 Jul 22 22:25:06.977314 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 645/1312] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:06 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1323 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:07.993788 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9fcca95d-38a5-4266-81ef-6dd05fef33f1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:07.994406 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9fcca95d-38a5-4266-81ef-6dd05fef33f1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:08.000286 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9fcca95d-38a5-4266-81ef-6dd05fef33f1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:08.000737 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9fcca95d-38a5-4266-81ef-6dd05fef33f1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:08.001486 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9fcca95d-38a5-4266-81ef-6dd05fef33f1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:08.001911 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9fcca95d-38a5-4266-81ef-6dd05fef33f1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:08.142338 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9fcca95d-38a5-4266-81ef-6dd05fef33f1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:08.149782 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9fcca95d-38a5-4266-81ef-6dd05fef33f1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1323 microversion: 2.1 time: 0.159575 Jul 22 22:25:08.150354 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 668/1313] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:07 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:09.166868 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-43252299-c7ad-411c-9e6c-3e8cd6ee07d1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:09.167485 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-43252299-c7ad-411c-9e6c-3e8cd6ee07d1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:09.174002 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-43252299-c7ad-411c-9e6c-3e8cd6ee07d1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:09.174456 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-43252299-c7ad-411c-9e6c-3e8cd6ee07d1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:09.175228 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-43252299-c7ad-411c-9e6c-3e8cd6ee07d1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:09.175666 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-43252299-c7ad-411c-9e6c-3e8cd6ee07d1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:09.311929 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-43252299-c7ad-411c-9e6c-3e8cd6ee07d1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:09.320804 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-43252299-c7ad-411c-9e6c-3e8cd6ee07d1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1323 microversion: 2.1 time: 0.157485 Jul 22 22:25:09.321466 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 646/1314] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:09 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:10.225710 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-fb27e2ad-e705-4ddc-abd9-7dc5d84103ee req-c0cf0b91-eceb-4653-931a-a7d11f2b214f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86af1817-2d1f-4697-b8d9-2917e150eb65", "name": "network-vif-plugged", "status": "completed", "tag": "3d6d74dd-5944-43a7-92f4-cdb257d328d4"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:25:10.227193 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:25:10.227193 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:25:10.234298 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-fb27e2ad-e705-4ddc-abd9-7dc5d84103ee req-c0cf0b91-eceb-4653-931a-a7d11f2b214f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:10.234735 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-fb27e2ad-e705-4ddc-abd9-7dc5d84103ee req-c0cf0b91-eceb-4653-931a-a7d11f2b214f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:10.245822 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-fb27e2ad-e705-4ddc-abd9-7dc5d84103ee req-c0cf0b91-eceb-4653-931a-a7d11f2b214f service nova] Creating event network-vif-plugged:3d6d74dd-5944-43a7-92f4-cdb257d328d4 for instance 86af1817-2d1f-4697-b8d9-2917e150eb65 on hv-cinder-80186 Jul 22 22:25:10.250934 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-fb27e2ad-e705-4ddc-abd9-7dc5d84103ee req-c0cf0b91-eceb-4653-931a-a7d11f2b214f service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028739 Jul 22 22:25:10.251764 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 669/1315] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:25:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:25:10.338383 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a44f74d6-58dc-4ef5-aa45-88fa001367a1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:10.338980 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a44f74d6-58dc-4ef5-aa45-88fa001367a1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:10.345984 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a44f74d6-58dc-4ef5-aa45-88fa001367a1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:10.346432 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a44f74d6-58dc-4ef5-aa45-88fa001367a1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:10.347212 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a44f74d6-58dc-4ef5-aa45-88fa001367a1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:10.347647 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a44f74d6-58dc-4ef5-aa45-88fa001367a1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:10.521531 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a44f74d6-58dc-4ef5-aa45-88fa001367a1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:10.528778 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a44f74d6-58dc-4ef5-aa45-88fa001367a1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1323 microversion: 2.1 time: 0.194163 Jul 22 22:25:10.529347 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 647/1316] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:10 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1323 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:11.547300 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e7e3ccc1-4938-4fbd-82b6-86986752f2e7 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:11.547999 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e7e3ccc1-4938-4fbd-82b6-86986752f2e7 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:11.553953 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7e3ccc1-4938-4fbd-82b6-86986752f2e7 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:11.554398 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7e3ccc1-4938-4fbd-82b6-86986752f2e7 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:11.555161 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7e3ccc1-4938-4fbd-82b6-86986752f2e7 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:11.555596 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e7e3ccc1-4938-4fbd-82b6-86986752f2e7 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:11.688786 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e7e3ccc1-4938-4fbd-82b6-86986752f2e7 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:11.696117 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e7e3ccc1-4938-4fbd-82b6-86986752f2e7 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1323 microversion: 2.1 time: 0.153524 Jul 22 22:25:11.696702 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 670/1317] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:11 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:12.713700 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-39a2fc61-cd52-4be2-82d2-ce2497e68ebc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:12.714338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-39a2fc61-cd52-4be2-82d2-ce2497e68ebc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:12.721149 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39a2fc61-cd52-4be2-82d2-ce2497e68ebc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:12.721597 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39a2fc61-cd52-4be2-82d2-ce2497e68ebc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:12.722373 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39a2fc61-cd52-4be2-82d2-ce2497e68ebc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:12.722806 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-39a2fc61-cd52-4be2-82d2-ce2497e68ebc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:12.859588 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-39a2fc61-cd52-4be2-82d2-ce2497e68ebc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:12.867178 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-39a2fc61-cd52-4be2-82d2-ce2497e68ebc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1512 microversion: 2.1 time: 0.157191 Jul 22 22:25:12.867743 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 648/1318] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:12 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:12.898120 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5a7d42e8-add9-492a-9d99-c5a43f192c78 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae9b5a10-8546-4d35-8fd7-cdb2a2be5e3e", "device": "/dev/sdb"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:25:12.900948 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5a7d42e8-add9-492a-9d99-c5a43f192c78 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:12.910950 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a7d42e8-add9-492a-9d99-c5a43f192c78 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:12.911740 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a7d42e8-add9-492a-9d99-c5a43f192c78 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:12.913113 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a7d42e8-add9-492a-9d99-c5a43f192c78 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:12.913904 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a7d42e8-add9-492a-9d99-c5a43f192c78 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:13.186934 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5a7d42e8-add9-492a-9d99-c5a43f192c78 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "POST /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296411 Jul 22 22:25:13.188261 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 671/1319] 10.222.0.110 () {60 vars in 1328 bytes} [Thu Jul 22 22:25:12 2021] POST /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:25:16.649387 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c72812dc-f969-4bd1-b6f6-829fc8a1cdaf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:16.650230 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c72812dc-f969-4bd1-b6f6-829fc8a1cdaf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:16.652314 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-4df33721-a605-4947-bd0a-97a8780bc807 req-6ce0ce2f-8b63-455c-b1d8-f17e052dd08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2161e34f-3610-4f6c-8f03-7ff89ef2c8ad", "tag": "ef2cf38b-40af-4b6a-be31-b0fa0cc57a37"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:25:16.654158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:25:16.654158 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:25:16.657821 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c72812dc-f969-4bd1-b6f6-829fc8a1cdaf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:16.658571 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c72812dc-f969-4bd1-b6f6-829fc8a1cdaf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:16.659435 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c72812dc-f969-4bd1-b6f6-829fc8a1cdaf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:16.659998 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c72812dc-f969-4bd1-b6f6-829fc8a1cdaf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:16.663126 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-4df33721-a605-4947-bd0a-97a8780bc807 req-6ce0ce2f-8b63-455c-b1d8-f17e052dd08c service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:16.663570 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-4df33721-a605-4947-bd0a-97a8780bc807 req-6ce0ce2f-8b63-455c-b1d8-f17e052dd08c service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:16.675732 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-4df33721-a605-4947-bd0a-97a8780bc807 req-6ce0ce2f-8b63-455c-b1d8-f17e052dd08c service nova] Creating event network-changed:ef2cf38b-40af-4b6a-be31-b0fa0cc57a37 for instance 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad on hv-cinder-80186 Jul 22 22:25:16.680831 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-4df33721-a605-4947-bd0a-97a8780bc807 req-6ce0ce2f-8b63-455c-b1d8-f17e052dd08c service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033287 Jul 22 22:25:16.681428 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 672/1320] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:25:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:25:16.687283 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c72812dc-f969-4bd1-b6f6-829fc8a1cdaf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:25:16.770878 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c72812dc-f969-4bd1-b6f6-829fc8a1cdaf tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "DELETE /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 204 len: 0 microversion: 2.1 time: 0.125342 Jul 22 22:25:16.771383 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 649/1321] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:25:16 2021] DELETE /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:25:16.779901 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-327eb9e1-33d3-46a4-9c1e-c0a16982df93 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:16.780897 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-327eb9e1-33d3-46a4-9c1e-c0a16982df93 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:16.788251 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-327eb9e1-33d3-46a4-9c1e-c0a16982df93 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:16.788991 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-327eb9e1-33d3-46a4-9c1e-c0a16982df93 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:16.789984 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-327eb9e1-33d3-46a4-9c1e-c0a16982df93 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:16.790644 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-327eb9e1-33d3-46a4-9c1e-c0a16982df93 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:16.942716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-327eb9e1-33d3-46a4-9c1e-c0a16982df93 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:16.950337 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-327eb9e1-33d3-46a4-9c1e-c0a16982df93 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1581 microversion: 2.1 time: 0.174334 Jul 22 22:25:16.950916 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 673/1322] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:16 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1581 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:17.968360 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-9df19a9b-9f24-485d-8959-651ac3051de4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:17.968974 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-9df19a9b-9f24-485d-8959-651ac3051de4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:17.975518 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9df19a9b-9f24-485d-8959-651ac3051de4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:17.975958 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9df19a9b-9f24-485d-8959-651ac3051de4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:17.976747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9df19a9b-9f24-485d-8959-651ac3051de4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:17.977174 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-9df19a9b-9f24-485d-8959-651ac3051de4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:18.115810 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-9df19a9b-9f24-485d-8959-651ac3051de4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:18.123177 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-9df19a9b-9f24-485d-8959-651ac3051de4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1462 microversion: 2.1 time: 0.159054 Jul 22 22:25:18.123744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 650/1323] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:17 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1462 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:19.140839 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9789c4c5-cc3e-4757-ad94-b379d0ef7fc2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:19.141586 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9789c4c5-cc3e-4757-ad94-b379d0ef7fc2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:19.148327 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9789c4c5-cc3e-4757-ad94-b379d0ef7fc2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:19.148780 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9789c4c5-cc3e-4757-ad94-b379d0ef7fc2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:19.149559 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9789c4c5-cc3e-4757-ad94-b379d0ef7fc2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:19.149996 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9789c4c5-cc3e-4757-ad94-b379d0ef7fc2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:19.292881 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9789c4c5-cc3e-4757-ad94-b379d0ef7fc2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:19.300461 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9789c4c5-cc3e-4757-ad94-b379d0ef7fc2 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1462 microversion: 2.1 time: 0.163238 Jul 22 22:25:19.301029 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 674/1324] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:19 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1462 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:19.669582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-6668ee1b-ccfd-47d6-83ff-7ca6688ac41b req-2e8b64e2-9d43-4804-a4b0-16f9d1f34688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2161e34f-3610-4f6c-8f03-7ff89ef2c8ad", "name": "network-vif-deleted", "tag": "ef2cf38b-40af-4b6a-be31-b0fa0cc57a37"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:25:19.671106 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:25:19.671106 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:25:19.677969 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-6668ee1b-ccfd-47d6-83ff-7ca6688ac41b req-2e8b64e2-9d43-4804-a4b0-16f9d1f34688 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:19.678408 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-6668ee1b-ccfd-47d6-83ff-7ca6688ac41b req-2e8b64e2-9d43-4804-a4b0-16f9d1f34688 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:19.690418 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-6668ee1b-ccfd-47d6-83ff-7ca6688ac41b req-2e8b64e2-9d43-4804-a4b0-16f9d1f34688 service nova] Creating event network-vif-deleted:ef2cf38b-40af-4b6a-be31-b0fa0cc57a37 for instance 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad on hv-cinder-80186 Jul 22 22:25:19.695043 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-6668ee1b-ccfd-47d6-83ff-7ca6688ac41b req-2e8b64e2-9d43-4804-a4b0-16f9d1f34688 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029098 Jul 22 22:25:19.695630 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 651/1325] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:25:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:25:20.318943 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6e326877-b8ad-48ec-8048-fbcdc207920e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:20.319536 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6e326877-b8ad-48ec-8048-fbcdc207920e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:20.325637 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6e326877-b8ad-48ec-8048-fbcdc207920e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:20.326089 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6e326877-b8ad-48ec-8048-fbcdc207920e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:20.326860 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6e326877-b8ad-48ec-8048-fbcdc207920e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:20.327292 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6e326877-b8ad-48ec-8048-fbcdc207920e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:20.357516 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6e326877-b8ad-48ec-8048-fbcdc207920e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:20.357958 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6e326877-b8ad-48ec-8048-fbcdc207920e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:20.358404 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-6e326877-b8ad-48ec-8048-fbcdc207920e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lazy-loading 'fault' on Instance uuid 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:25:20.401328 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6e326877-b8ad-48ec-8048-fbcdc207920e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:20.408820 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6e326877-b8ad-48ec-8048-fbcdc207920e tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 200 len: 1233 microversion: 2.1 time: 0.094292 Jul 22 22:25:20.409381 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 675/1326] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:20 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 1233 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:21.427270 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4370b68f-47b6-4f68-832e-9a080e4c43f0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:21.427892 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4370b68f-47b6-4f68-832e-9a080e4c43f0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:21.434862 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4370b68f-47b6-4f68-832e-9a080e4c43f0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:21.435301 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4370b68f-47b6-4f68-832e-9a080e4c43f0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:21.436093 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4370b68f-47b6-4f68-832e-9a080e4c43f0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:21.436558 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4370b68f-47b6-4f68-832e-9a080e4c43f0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:21.451673 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-4370b68f-47b6-4f68-832e-9a080e4c43f0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] HTTP exception thrown: Instance 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad could not be found. Jul 22 22:25:21.452257 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4370b68f-47b6-4f68-832e-9a080e4c43f0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Returning 404 to user: Instance 2161e34f-3610-4f6c-8f03-7ff89ef2c8ad could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:25:21.453100 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4370b68f-47b6-4f68-832e-9a080e4c43f0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad" status: 404 len: 111 microversion: 2.1 time: 0.031187 Jul 22 22:25:21.453734 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 652/1327] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:21 2021] GET /compute/v2.1/servers/2161e34f-3610-4f6c-8f03-7ff89ef2c8ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:25:27.950829 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-cf7b660e-e5b9-4fe7-ab0e-e3b783b2a48b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:27.951364 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-cf7b660e-e5b9-4fe7-ab0e-e3b783b2a48b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:27.953364 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-3fd13731-8e42-4677-9be3-6d8918a851c8 req-4623f969-352b-4378-aa63-85d130c58e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42179d6a-451f-4dca-83f8-042ff823e17c", "tag": "d51d96d5-7ed6-46ea-ac2b-42c80c4d2a76"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:25:27.955392 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:25:27.955392 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:25:27.958836 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cf7b660e-e5b9-4fe7-ab0e-e3b783b2a48b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:27.959287 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cf7b660e-e5b9-4fe7-ab0e-e3b783b2a48b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:27.960077 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cf7b660e-e5b9-4fe7-ab0e-e3b783b2a48b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:27.960582 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-cf7b660e-e5b9-4fe7-ab0e-e3b783b2a48b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:27.962869 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-3fd13731-8e42-4677-9be3-6d8918a851c8 req-4623f969-352b-4378-aa63-85d130c58e56 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:27.963319 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-3fd13731-8e42-4677-9be3-6d8918a851c8 req-4623f969-352b-4378-aa63-85d130c58e56 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:27.974893 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-3fd13731-8e42-4677-9be3-6d8918a851c8 req-4623f969-352b-4378-aa63-85d130c58e56 service nova] Creating event network-changed:d51d96d5-7ed6-46ea-ac2b-42c80c4d2a76 for instance 42179d6a-451f-4dca-83f8-042ff823e17c on hv-cinder-80186 Jul 22 22:25:27.979818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-3fd13731-8e42-4677-9be3-6d8918a851c8 req-4623f969-352b-4378-aa63-85d130c58e56 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030502 Jul 22 22:25:27.980755 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 653/1328] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:25:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:25:27.989162 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-cf7b660e-e5b9-4fe7-ab0e-e3b783b2a48b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Going to try to terminate instance {{(pid=107499) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:25:28.063613 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-cf7b660e-e5b9-4fe7-ab0e-e3b783b2a48b tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "DELETE /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 204 len: 0 microversion: 2.1 time: 0.116611 Jul 22 22:25:28.065045 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 676/1329] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:25:27 2021] DELETE /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:25:28.073559 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-acef982a-590d-4cc7-beb9-9df864442445 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:28.074263 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-acef982a-590d-4cc7-beb9-9df864442445 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:28.080894 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-acef982a-590d-4cc7-beb9-9df864442445 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:28.081343 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-acef982a-590d-4cc7-beb9-9df864442445 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:28.082119 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-acef982a-590d-4cc7-beb9-9df864442445 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:28.082563 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-acef982a-590d-4cc7-beb9-9df864442445 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:28.237547 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-acef982a-590d-4cc7-beb9-9df864442445 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:28.245098 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-acef982a-590d-4cc7-beb9-9df864442445 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1583 microversion: 2.1 time: 0.175508 Jul 22 22:25:28.245661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 654/1330] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:28 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1583 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:29.262855 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-abc4d4e2-a778-4e63-bd7f-8bc135fad230 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:29.263590 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-abc4d4e2-a778-4e63-bd7f-8bc135fad230 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:29.270678 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-abc4d4e2-a778-4e63-bd7f-8bc135fad230 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:29.271065 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-abc4d4e2-a778-4e63-bd7f-8bc135fad230 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:29.271818 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-abc4d4e2-a778-4e63-bd7f-8bc135fad230 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:29.272254 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-abc4d4e2-a778-4e63-bd7f-8bc135fad230 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:29.417082 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-abc4d4e2-a778-4e63-bd7f-8bc135fad230 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:29.429415 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-abc4d4e2-a778-4e63-bd7f-8bc135fad230 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1583 microversion: 2.1 time: 0.170299 Jul 22 22:25:29.430629 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 677/1331] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:29 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1583 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:30.453454 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-53865912-5748-4050-a1d9-a538c30814ba tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:30.454068 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-53865912-5748-4050-a1d9-a538c30814ba tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:30.460003 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53865912-5748-4050-a1d9-a538c30814ba tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:30.460490 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53865912-5748-4050-a1d9-a538c30814ba tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:30.461265 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53865912-5748-4050-a1d9-a538c30814ba tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:30.461695 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53865912-5748-4050-a1d9-a538c30814ba tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:30.601736 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-53865912-5748-4050-a1d9-a538c30814ba tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:30.609241 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-53865912-5748-4050-a1d9-a538c30814ba tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1583 microversion: 2.1 time: 0.159548 Jul 22 22:25:30.609799 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 655/1332] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:30 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1583 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:31.626835 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5a968675-358c-4d0f-8b6a-ffdc739494b4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:31.627479 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5a968675-358c-4d0f-8b6a-ffdc739494b4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:31.633213 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a968675-358c-4d0f-8b6a-ffdc739494b4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:31.633688 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a968675-358c-4d0f-8b6a-ffdc739494b4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:31.634451 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a968675-358c-4d0f-8b6a-ffdc739494b4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:31.634882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5a968675-358c-4d0f-8b6a-ffdc739494b4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:31.776161 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5a968675-358c-4d0f-8b6a-ffdc739494b4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:31.784093 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5a968675-358c-4d0f-8b6a-ffdc739494b4 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1464 microversion: 2.1 time: 0.161004 Jul 22 22:25:31.784682 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 678/1333] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:31 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:32.800458 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-498f71ef-c8d5-4685-97e8-278b344ff20c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:32.801120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-498f71ef-c8d5-4685-97e8-278b344ff20c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:32.807317 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-498f71ef-c8d5-4685-97e8-278b344ff20c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:32.807773 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-498f71ef-c8d5-4685-97e8-278b344ff20c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:32.808606 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-498f71ef-c8d5-4685-97e8-278b344ff20c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:32.809013 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-498f71ef-c8d5-4685-97e8-278b344ff20c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:32.977893 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-498f71ef-c8d5-4685-97e8-278b344ff20c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:32.985268 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-498f71ef-c8d5-4685-97e8-278b344ff20c tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1464 microversion: 2.1 time: 0.188629 Jul 22 22:25:32.986524 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 656/1334] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:32 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1464 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:33.437426 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-a4e16d05-ae37-4fb2-9a6d-05050867d250 req-344bd2c1-7cc1-4920-aa3a-08056ee5dc15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42179d6a-451f-4dca-83f8-042ff823e17c", "name": "network-vif-deleted", "tag": "d51d96d5-7ed6-46ea-ac2b-42c80c4d2a76"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:25:33.439747 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:25:33.439747 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:25:33.446836 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-a4e16d05-ae37-4fb2-9a6d-05050867d250 req-344bd2c1-7cc1-4920-aa3a-08056ee5dc15 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:33.447293 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-a4e16d05-ae37-4fb2-9a6d-05050867d250 req-344bd2c1-7cc1-4920-aa3a-08056ee5dc15 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:33.460537 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-a4e16d05-ae37-4fb2-9a6d-05050867d250 req-344bd2c1-7cc1-4920-aa3a-08056ee5dc15 service nova] Creating event network-vif-deleted:d51d96d5-7ed6-46ea-ac2b-42c80c4d2a76 for instance 42179d6a-451f-4dca-83f8-042ff823e17c on hv-cinder-80186 Jul 22 22:25:33.465291 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-a4e16d05-ae37-4fb2-9a6d-05050867d250 req-344bd2c1-7cc1-4920-aa3a-08056ee5dc15 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031405 Jul 22 22:25:33.465882 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 679/1335] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:25:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:25:33.509275 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-69e72702-445d-4a48-9f30-6e09a6a7acbc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:33.509773 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-69e72702-445d-4a48-9f30-6e09a6a7acbc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:33.515532 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-69e72702-445d-4a48-9f30-6e09a6a7acbc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:33.515981 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-69e72702-445d-4a48-9f30-6e09a6a7acbc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:33.517929 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-69e72702-445d-4a48-9f30-6e09a6a7acbc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:33.518480 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-69e72702-445d-4a48-9f30-6e09a6a7acbc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:33.603405 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.objects.instance [None req-69e72702-445d-4a48-9f30-6e09a6a7acbc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lazy-loading 'services' on Instance uuid 86af1817-2d1f-4697-b8d9-2917e150eb65 {{(pid=107498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:25:33.670459 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-69e72702-445d-4a48-9f30-6e09a6a7acbc tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "DELETE /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65/os-volume_attachments/ae9b5a10-8546-4d35-8fd7-cdb2a2be5e3e" status: 202 len: 0 microversion: 2.1 time: 0.164850 Jul 22 22:25:33.671064 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 657/1336] 10.222.0.110 () {58 vars in 1421 bytes} [Thu Jul 22 22:25:33 2021] DELETE /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65/os-volume_attachments/ae9b5a10-8546-4d35-8fd7-cdb2a2be5e3e => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:25:34.003038 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-53aae62f-fb09-416d-b3c2-fc8fd6be8ad0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:34.003653 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-53aae62f-fb09-416d-b3c2-fc8fd6be8ad0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:34.009969 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-53aae62f-fb09-416d-b3c2-fc8fd6be8ad0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:34.010420 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-53aae62f-fb09-416d-b3c2-fc8fd6be8ad0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:34.011252 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-53aae62f-fb09-416d-b3c2-fc8fd6be8ad0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:34.011685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-53aae62f-fb09-416d-b3c2-fc8fd6be8ad0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:34.041308 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-53aae62f-fb09-416d-b3c2-fc8fd6be8ad0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:34.041755 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-53aae62f-fb09-416d-b3c2-fc8fd6be8ad0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:34.042201 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-53aae62f-fb09-416d-b3c2-fc8fd6be8ad0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lazy-loading 'fault' on Instance uuid 42179d6a-451f-4dca-83f8-042ff823e17c {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:25:34.084610 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-53aae62f-fb09-416d-b3c2-fc8fd6be8ad0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4af694abdd744df1beb130211b80774a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '853ea27311ea40e185ea767354f4dec1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:34.091869 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-53aae62f-fb09-416d-b3c2-fc8fd6be8ad0 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 200 len: 1234 microversion: 2.1 time: 0.093757 Jul 22 22:25:34.092661 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 680/1337] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:33 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 1234 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:34.797195 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-768f3f20-fa80-46f1-a1d5-d3ff8de19db6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:34.798286 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-768f3f20-fa80-46f1-a1d5-d3ff8de19db6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:34.804965 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-768f3f20-fa80-46f1-a1d5-d3ff8de19db6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:34.805417 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-768f3f20-fa80-46f1-a1d5-d3ff8de19db6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:34.806191 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-768f3f20-fa80-46f1-a1d5-d3ff8de19db6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:34.806657 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-768f3f20-fa80-46f1-a1d5-d3ff8de19db6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:34.832522 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-768f3f20-fa80-46f1-a1d5-d3ff8de19db6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:25:34.906342 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-768f3f20-fa80-46f1-a1d5-d3ff8de19db6 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "DELETE /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 204 len: 0 microversion: 2.1 time: 0.112738 Jul 22 22:25:34.906924 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 658/1338] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:25:34 2021] DELETE /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:25:34.915699 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-02d4d489-adb5-4b70-8de8-30f8f37ff238 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:34.916469 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-02d4d489-adb5-4b70-8de8-30f8f37ff238 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:34.922539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-02d4d489-adb5-4b70-8de8-30f8f37ff238 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:34.923672 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-02d4d489-adb5-4b70-8de8-30f8f37ff238 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:34.924567 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-02d4d489-adb5-4b70-8de8-30f8f37ff238 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:34.925171 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-02d4d489-adb5-4b70-8de8-30f8f37ff238 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:35.066405 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-02d4d489-adb5-4b70-8de8-30f8f37ff238 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:35.073786 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-02d4d489-adb5-4b70-8de8-30f8f37ff238 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1518 microversion: 2.1 time: 0.161761 Jul 22 22:25:35.074359 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 681/1339] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:34 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:35.109428 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2e343612-41ce-4f66-9e1b-fa947a468601 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:35.110147 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2e343612-41ce-4f66-9e1b-fa947a468601 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 42179d6a-451f-4dca-83f8-042ff823e17c] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:35.116791 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2e343612-41ce-4f66-9e1b-fa947a468601 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:35.117239 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2e343612-41ce-4f66-9e1b-fa947a468601 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:35.118004 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2e343612-41ce-4f66-9e1b-fa947a468601 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:35.118438 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2e343612-41ce-4f66-9e1b-fa947a468601 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:35.131627 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-2e343612-41ce-4f66-9e1b-fa947a468601 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] HTTP exception thrown: Instance 42179d6a-451f-4dca-83f8-042ff823e17c could not be found. Jul 22 22:25:35.132203 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2e343612-41ce-4f66-9e1b-fa947a468601 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Returning 404 to user: Instance 42179d6a-451f-4dca-83f8-042ff823e17c could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:25:35.133041 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2e343612-41ce-4f66-9e1b-fa947a468601 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c" status: 404 len: 111 microversion: 2.1 time: 0.027664 Jul 22 22:25:35.133566 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 659/1340] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:35 2021] GET /compute/v2.1/servers/42179d6a-451f-4dca-83f8-042ff823e17c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:25:35.590872 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-78709247-de7e-4938-848d-16b548e81a04 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:35.591311 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-78709247-de7e-4938-848d-16b548e81a04 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:35.598502 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-78709247-de7e-4938-848d-16b548e81a04 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:35.598951 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-78709247-de7e-4938-848d-16b548e81a04 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:35.599730 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-78709247-de7e-4938-848d-16b548e81a04 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:35.600168 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-78709247-de7e-4938-848d-16b548e81a04 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:35.614687 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.wsgi [None req-78709247-de7e-4938-848d-16b548e81a04 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] HTTP exception thrown: Instance 230e9e16-9304-4b70-bf95-34811d9fd221 could not be found. Jul 22 22:25:35.615283 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-78709247-de7e-4938-848d-16b548e81a04 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Returning 404 to user: Instance 230e9e16-9304-4b70-bf95-34811d9fd221 could not be found. {{(pid=107499) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:25:35.616119 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-78709247-de7e-4938-848d-16b548e81a04 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "DELETE /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 404 len: 111 microversion: 2.1 time: 0.028989 Jul 22 22:25:35.616703 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 682/1341] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:25:35 2021] DELETE /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:25:35.624707 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c9e864ce-ce98-4a25-8589-552dcb46bb56 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:35.625337 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-c9e864ce-ce98-4a25-8589-552dcb46bb56 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [instance: 230e9e16-9304-4b70-bf95-34811d9fd221] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:35.631289 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c9e864ce-ce98-4a25-8589-552dcb46bb56 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:35.631746 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c9e864ce-ce98-4a25-8589-552dcb46bb56 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:35.632521 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c9e864ce-ce98-4a25-8589-552dcb46bb56 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:35.632947 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-c9e864ce-ce98-4a25-8589-552dcb46bb56 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:35.646485 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-c9e864ce-ce98-4a25-8589-552dcb46bb56 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] HTTP exception thrown: Instance 230e9e16-9304-4b70-bf95-34811d9fd221 could not be found. Jul 22 22:25:35.647064 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-c9e864ce-ce98-4a25-8589-552dcb46bb56 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Returning 404 to user: Instance 230e9e16-9304-4b70-bf95-34811d9fd221 could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:25:35.647868 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-c9e864ce-ce98-4a25-8589-552dcb46bb56 tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221" status: 404 len: 111 microversion: 2.1 time: 0.026815 Jul 22 22:25:35.648405 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 660/1342] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:35 2021] GET /compute/v2.1/servers/230e9e16-9304-4b70-bf95-34811d9fd221 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:25:36.090704 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b44063d9-97d1-4127-a8bd-03d8748b94ff tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:36.091307 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b44063d9-97d1-4127-a8bd-03d8748b94ff tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:36.098289 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b44063d9-97d1-4127-a8bd-03d8748b94ff tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:36.098752 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b44063d9-97d1-4127-a8bd-03d8748b94ff tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:36.099523 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b44063d9-97d1-4127-a8bd-03d8748b94ff tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:36.099985 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b44063d9-97d1-4127-a8bd-03d8748b94ff tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:36.244615 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b44063d9-97d1-4127-a8bd-03d8748b94ff tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:36.252685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b44063d9-97d1-4127-a8bd-03d8748b94ff tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1518 microversion: 2.1 time: 0.165661 Jul 22 22:25:36.253252 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 683/1343] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:36 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:36.933826 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4914ec8d-8a7b-4af3-817c-868aa6bde34f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] Calling method '.version_select at 0x7f7d1c475b80>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:36.937184 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4914ec8d-8a7b-4af3-817c-868aa6bde34f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [c1148488-482d-4692-bba0-81927ae4a537] AMQP server on 10.222.0.110:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 22 22:25:37.269600 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ce490603-6fd4-4ad6-a8fe-513db87373e0 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:37.270203 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ce490603-6fd4-4ad6-a8fe-513db87373e0 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:37.275992 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ce490603-6fd4-4ad6-a8fe-513db87373e0 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:37.276478 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ce490603-6fd4-4ad6-a8fe-513db87373e0 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:37.277226 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ce490603-6fd4-4ad6-a8fe-513db87373e0 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:37.277649 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ce490603-6fd4-4ad6-a8fe-513db87373e0 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:37.414692 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ce490603-6fd4-4ad6-a8fe-513db87373e0 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:37.422107 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ce490603-6fd4-4ad6-a8fe-513db87373e0 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1518 microversion: 2.1 time: 0.156149 Jul 22 22:25:37.422905 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 684/1344] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:37 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:25:37.881548 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-b115f8b2-b2d4-41b8-adc0-fac33c0aa715 req-4a3ec511-70d8-4960-bb14-30045c9a5160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86af1817-2d1f-4697-b8d9-2917e150eb65", "name": "network-vif-deleted", "tag": "3d6d74dd-5944-43a7-92f4-cdb257d328d4"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:25:37.883443 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:25:37.883443 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:25:37.891869 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-b115f8b2-b2d4-41b8-adc0-fac33c0aa715 req-4a3ec511-70d8-4960-bb14-30045c9a5160 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:37.892413 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-b115f8b2-b2d4-41b8-adc0-fac33c0aa715 req-4a3ec511-70d8-4960-bb14-30045c9a5160 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:37.904157 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-b115f8b2-b2d4-41b8-adc0-fac33c0aa715 req-4a3ec511-70d8-4960-bb14-30045c9a5160 service nova] Creating event network-vif-deleted:3d6d74dd-5944-43a7-92f4-cdb257d328d4 for instance 86af1817-2d1f-4697-b8d9-2917e150eb65 on hv-cinder-80186 Jul 22 22:25:37.909764 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-b115f8b2-b2d4-41b8-adc0-fac33c0aa715 req-4a3ec511-70d8-4960-bb14-30045c9a5160 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031792 Jul 22 22:25:37.910352 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 685/1345] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:25:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 22 22:25:37.958195 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [None req-4914ec8d-8a7b-4af3-817c-868aa6bde34f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] [c1148488-482d-4692-bba0-81927ae4a537] Reconnected to AMQP server on 10.222.0.110:5672 via [amqp] client with port 38142. Jul 22 22:25:37.978639 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4914ec8d-8a7b-4af3-817c-868aa6bde34f tempest-TestVolumeBootPattern-955612247 tempest-TestVolumeBootPattern-955612247-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1673230260" status: 202 len: 0 microversion: 2.1 time: 1.047820 Jul 22 22:25:37.978639 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 661/1346] 10.222.0.110 () {58 vars in 1268 bytes} [Thu Jul 22 22:25:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1673230260 => generated 0 bytes in 1049 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:25:38.441402 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-c874fb45-7130-4622-8018-ed01ac4f5203 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:38.442108 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-c874fb45-7130-4622-8018-ed01ac4f5203 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:38.448681 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c874fb45-7130-4622-8018-ed01ac4f5203 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:38.449127 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c874fb45-7130-4622-8018-ed01ac4f5203 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:38.449905 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c874fb45-7130-4622-8018-ed01ac4f5203 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:38.450340 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c874fb45-7130-4622-8018-ed01ac4f5203 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:38.484609 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c874fb45-7130-4622-8018-ed01ac4f5203 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:38.486120 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-c874fb45-7130-4622-8018-ed01ac4f5203 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:38.487250 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-c874fb45-7130-4622-8018-ed01ac4f5203 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lazy-loading 'fault' on Instance uuid 86af1817-2d1f-4697-b8d9-2917e150eb65 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:25:38.534707 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-c874fb45-7130-4622-8018-ed01ac4f5203 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2acf16131e2442ebe76e681152a4dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2673840a4eb443a5814175271c259f76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:25:38.543766 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-c874fb45-7130-4622-8018-ed01ac4f5203 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 200 len: 1313 microversion: 2.1 time: 0.108477 Jul 22 22:25:38.544571 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 686/1347] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:38 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 1313 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:25:39.561749 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-82ef0675-eba4-4d79-bf5c-9bcc4de27ec1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:25:39.562376 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-82ef0675-eba4-4d79-bf5c-9bcc4de27ec1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] [instance: 86af1817-2d1f-4697-b8d9-2917e150eb65] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:25:39.569992 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-82ef0675-eba4-4d79-bf5c-9bcc4de27ec1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:39.570438 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-82ef0675-eba4-4d79-bf5c-9bcc4de27ec1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:39.571211 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-82ef0675-eba4-4d79-bf5c-9bcc4de27ec1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:25:39.571642 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-82ef0675-eba4-4d79-bf5c-9bcc4de27ec1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:25:39.587531 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-82ef0675-eba4-4d79-bf5c-9bcc4de27ec1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] HTTP exception thrown: Instance 86af1817-2d1f-4697-b8d9-2917e150eb65 could not be found. Jul 22 22:25:39.588125 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-82ef0675-eba4-4d79-bf5c-9bcc4de27ec1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] Returning 404 to user: Instance 86af1817-2d1f-4697-b8d9-2917e150eb65 could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:25:39.588991 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-82ef0675-eba4-4d79-bf5c-9bcc4de27ec1 tempest-VolumesSnapshotTestJSON-155871760 tempest-VolumesSnapshotTestJSON-155871760-project] 10.222.0.110 "GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65" status: 404 len: 111 microversion: 2.1 time: 0.031072 Jul 22 22:25:39.589544 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 662/1348] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:25:39 2021] GET /compute/v2.1/servers/86af1817-2d1f-4697-b8d9-2917e150eb65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:26:33.998580 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-fab3d0e1-dfde-4574-86dd-f38b5096753c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Action: 'create', calling method: .version_select at 0x7f7d1365ba60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1809215571"}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:26:34.016915 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-fab3d0e1-dfde-4574-86dd-f38b5096753c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Getting quotas for project 748160a4ef46401a8836e6b4346ee31c. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:26:34.020873 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-fab3d0e1-dfde-4574-86dd-f38b5096753c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Getting quotas for user 92ddd9c32ba24fccbc7fc5f099be1f5e and project 748160a4ef46401a8836e6b4346ee31c. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:26:34.292224 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-fab3d0e1-dfde-4574-86dd-f38b5096753c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Getting quotas for project 748160a4ef46401a8836e6b4346ee31c. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:26:34.296124 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.quota [None req-fab3d0e1-dfde-4574-86dd-f38b5096753c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Getting quotas for user 92ddd9c32ba24fccbc7fc5f099be1f5e and project 748160a4ef46401a8836e6b4346ee31c. Resources: {'key_pairs'} {{(pid=107499) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:26:34.311643 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-fab3d0e1-dfde-4574-86dd-f38b5096753c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.531919 Jul 22 22:26:34.312236 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 687/1349] 10.222.0.110 () {60 vars in 1163 bytes} [Thu Jul 22 22:26:33 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:26:51.501616 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:26:51.502157 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: Thu Jul 22 22:26:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:26:56.798650 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1575694086", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1809215571", "security_groups": [{"name": "tempest-secgroup-smoke-1412966022"}], "networks": [{"uuid": "d44697b3-4376-4213-9e05-bb4ad99055e9"}], "block_device_mapping_v2": [{"uuid": "30239d47-5d49-415f-8099-47a1f56d1024", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:26:56.902582 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.network.neutron [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] validate_networks() for [('d44697b3-4376-4213-9e05-bb4ad99055e9', None, None, None)] {{(pid=107498) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Jul 22 22:26:57.388585 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Flavor limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 22 22:26:57.389035 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Image limits 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 22 22:26:57.389509 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Flavor pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 22 22:26:57.389917 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Image pref 0:0:0 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 22 22:26:57.390325 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.virt.hardware [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 22 22:26:57.398788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:26:57.399224 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:26:57.400023 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:26:57.400579 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:26:57.417266 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Getting quotas for project 748160a4ef46401a8836e6b4346ee31c. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 22 22:26:57.421249 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.quota [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Getting quotas for user 92ddd9c32ba24fccbc7fc5f099be1f5e and project 748160a4ef46401a8836e6b4346ee31c. Resources: {'cores', 'instances', 'ram'} {{(pid=107498) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 22 22:26:57.485506 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Going to run 1 instances... {{(pid=107498) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 22 22:26:57.487623 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='30239d47-5d49-415f-8099-47a1f56d1024',volume_size=None,volume_type=None)] {{(pid=107498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 22 22:26:57.608504 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7f5abdc1-d0d2-4ff7-a7c8-5aa5e8bc744b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.814762 Jul 22 22:26:57.609137 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 663/1350] 10.222.0.110 () {60 vars in 1152 bytes} [Thu Jul 22 22:26:56 2021] POST /compute/v2.1/servers => generated 408 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 22 22:26:57.619014 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-27542d82-5275-4c61-966a-b0c1e66c8a7e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:26:57.619724 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-27542d82-5275-4c61-966a-b0c1e66c8a7e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:26:57.675370 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-27542d82-5275-4c61-966a-b0c1e66c8a7e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:26:57.682748 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-27542d82-5275-4c61-966a-b0c1e66c8a7e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1092 microversion: 2.1 time: 0.067674 Jul 22 22:26:57.683313 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 688/1351] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:26:57 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:26:58.699796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4c74f30d-f42e-403d-9200-1b2600f59446 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:26:58.700572 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4c74f30d-f42e-403d-9200-1b2600f59446 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:26:58.706416 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4c74f30d-f42e-403d-9200-1b2600f59446 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:26:58.706869 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4c74f30d-f42e-403d-9200-1b2600f59446 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:26:58.707668 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4c74f30d-f42e-403d-9200-1b2600f59446 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:26:58.708090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4c74f30d-f42e-403d-9200-1b2600f59446 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:26:58.770710 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4c74f30d-f42e-403d-9200-1b2600f59446 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:26:58.778232 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4c74f30d-f42e-403d-9200-1b2600f59446 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1190 microversion: 2.1 time: 0.083255 Jul 22 22:26:58.778785 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 664/1352] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:26:58 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1190 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:26:59.795628 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-af91070f-f7f2-43c3-8190-e5845308f70a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:26:59.796185 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-af91070f-f7f2-43c3-8190-e5845308f70a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:26:59.802834 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-af91070f-f7f2-43c3-8190-e5845308f70a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:26:59.803273 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-af91070f-f7f2-43c3-8190-e5845308f70a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:26:59.804047 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-af91070f-f7f2-43c3-8190-e5845308f70a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:26:59.804522 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-af91070f-f7f2-43c3-8190-e5845308f70a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:26:59.872675 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-af91070f-f7f2-43c3-8190-e5845308f70a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:26:59.880914 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-af91070f-f7f2-43c3-8190-e5845308f70a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1208 microversion: 2.1 time: 0.088547 Jul 22 22:26:59.881603 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 689/1353] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:26:59 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1208 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:00.898826 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b0082346-5084-4681-9e97-4054da300f76 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:00.900157 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b0082346-5084-4681-9e97-4054da300f76 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:00.907050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0082346-5084-4681-9e97-4054da300f76 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:00.907750 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0082346-5084-4681-9e97-4054da300f76 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:00.908896 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0082346-5084-4681-9e97-4054da300f76 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:00.909502 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0082346-5084-4681-9e97-4054da300f76 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:01.018643 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-e37a1c0a-35eb-44c9-8374-064ec9af4b5c req-04cc9952-1a50-42e7-bbcd-f340708c9f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030bdb92-2107-4494-8e09-344eb31a0729", "tag": "a4921983-190d-442c-9183-00b08dbb9001"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:27:01.020938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:27:01.020938 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:27:01.030152 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-e37a1c0a-35eb-44c9-8374-064ec9af4b5c req-04cc9952-1a50-42e7-bbcd-f340708c9f05 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:01.030904 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-e37a1c0a-35eb-44c9-8374-064ec9af4b5c req-04cc9952-1a50-42e7-bbcd-f340708c9f05 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:01.049813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-e37a1c0a-35eb-44c9-8374-064ec9af4b5c req-04cc9952-1a50-42e7-bbcd-f340708c9f05 service nova] Creating event network-changed:a4921983-190d-442c-9183-00b08dbb9001 for instance 030bdb92-2107-4494-8e09-344eb31a0729 on hv-cinder-80186 Jul 22 22:27:01.059763 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-e37a1c0a-35eb-44c9-8374-064ec9af4b5c req-04cc9952-1a50-42e7-bbcd-f340708c9f05 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040000 Jul 22 22:27:01.060556 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 690/1354] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:27:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:27:01.117547 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b0082346-5084-4681-9e97-4054da300f76 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:01.125732 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b0082346-5084-4681-9e97-4054da300f76 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1264 microversion: 2.1 time: 0.230479 Jul 22 22:27:01.126304 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 665/1355] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:00 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:02.146223 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f8961ea8-42da-4a7d-8ff9-296ed16415b1 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:02.147025 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f8961ea8-42da-4a7d-8ff9-296ed16415b1 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:02.154280 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f8961ea8-42da-4a7d-8ff9-296ed16415b1 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:02.154813 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f8961ea8-42da-4a7d-8ff9-296ed16415b1 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:02.155611 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f8961ea8-42da-4a7d-8ff9-296ed16415b1 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:02.156042 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f8961ea8-42da-4a7d-8ff9-296ed16415b1 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:02.318805 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f8961ea8-42da-4a7d-8ff9-296ed16415b1 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:02.326614 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f8961ea8-42da-4a7d-8ff9-296ed16415b1 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1264 microversion: 2.1 time: 0.186417 Jul 22 22:27:02.327039 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 691/1356] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:02 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:03.343661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d35907bc-6680-4acc-a73f-77554d3f2f85 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:03.344305 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d35907bc-6680-4acc-a73f-77554d3f2f85 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:03.350228 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d35907bc-6680-4acc-a73f-77554d3f2f85 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:03.350678 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d35907bc-6680-4acc-a73f-77554d3f2f85 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:03.351444 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d35907bc-6680-4acc-a73f-77554d3f2f85 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:03.351874 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d35907bc-6680-4acc-a73f-77554d3f2f85 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:03.490624 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d35907bc-6680-4acc-a73f-77554d3f2f85 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:03.498804 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d35907bc-6680-4acc-a73f-77554d3f2f85 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1264 microversion: 2.1 time: 0.158935 Jul 22 22:27:03.499359 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 666/1357] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:03 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:04.515606 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-032d7fcd-6553-480b-a8cb-d7083db35ca0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:04.516180 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-032d7fcd-6553-480b-a8cb-d7083db35ca0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:04.522023 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-032d7fcd-6553-480b-a8cb-d7083db35ca0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:04.522468 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-032d7fcd-6553-480b-a8cb-d7083db35ca0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:04.523234 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-032d7fcd-6553-480b-a8cb-d7083db35ca0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:04.523664 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-032d7fcd-6553-480b-a8cb-d7083db35ca0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:04.659132 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-032d7fcd-6553-480b-a8cb-d7083db35ca0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:04.667170 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-032d7fcd-6553-480b-a8cb-d7083db35ca0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1264 microversion: 2.1 time: 0.155477 Jul 22 22:27:04.667734 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 692/1358] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:04 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:05.684103 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-0cfb377e-f127-4ca0-9d8d-0024e4274bac tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:05.684743 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-0cfb377e-f127-4ca0-9d8d-0024e4274bac tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:05.690661 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cfb377e-f127-4ca0-9d8d-0024e4274bac tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:05.691108 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cfb377e-f127-4ca0-9d8d-0024e4274bac tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:05.691880 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cfb377e-f127-4ca0-9d8d-0024e4274bac tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:05.692345 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-0cfb377e-f127-4ca0-9d8d-0024e4274bac tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:05.825849 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-0cfb377e-f127-4ca0-9d8d-0024e4274bac tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:05.833223 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-0cfb377e-f127-4ca0-9d8d-0024e4274bac tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1264 microversion: 2.1 time: 0.153294 Jul 22 22:27:05.833779 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 667/1359] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:05 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:06.850941 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1130353d-78d8-436f-b107-2045bce43574 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:06.851554 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1130353d-78d8-436f-b107-2045bce43574 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:06.858489 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1130353d-78d8-436f-b107-2045bce43574 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:06.858936 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1130353d-78d8-436f-b107-2045bce43574 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:06.859702 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1130353d-78d8-436f-b107-2045bce43574 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:06.860136 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1130353d-78d8-436f-b107-2045bce43574 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:06.993656 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1130353d-78d8-436f-b107-2045bce43574 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:07.000777 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1130353d-78d8-436f-b107-2045bce43574 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1264 microversion: 2.1 time: 0.153784 Jul 22 22:27:07.001323 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 693/1360] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:06 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:08.017246 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b0e2feec-5746-434f-8811-1a0dbc4362cb tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:08.017863 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b0e2feec-5746-434f-8811-1a0dbc4362cb tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:08.023747 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0e2feec-5746-434f-8811-1a0dbc4362cb tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:08.024989 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0e2feec-5746-434f-8811-1a0dbc4362cb tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:08.025836 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0e2feec-5746-434f-8811-1a0dbc4362cb tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:08.026268 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b0e2feec-5746-434f-8811-1a0dbc4362cb tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:08.174686 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b0e2feec-5746-434f-8811-1a0dbc4362cb tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:08.177216 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b0e2feec-5746-434f-8811-1a0dbc4362cb tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1264 microversion: 2.1 time: 0.163558 Jul 22 22:27:08.177892 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 668/1361] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:08 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:09.195101 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-f6f618ab-4622-4df8-84fe-7f95b5fd5c84 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:09.195711 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-f6f618ab-4622-4df8-84fe-7f95b5fd5c84 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:09.201705 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f6f618ab-4622-4df8-84fe-7f95b5fd5c84 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:09.202137 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f6f618ab-4622-4df8-84fe-7f95b5fd5c84 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:09.202893 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f6f618ab-4622-4df8-84fe-7f95b5fd5c84 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:09.203322 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-f6f618ab-4622-4df8-84fe-7f95b5fd5c84 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:09.343295 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-f6f618ab-4622-4df8-84fe-7f95b5fd5c84 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:09.350680 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-f6f618ab-4622-4df8-84fe-7f95b5fd5c84 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1264 microversion: 2.1 time: 0.159262 Jul 22 22:27:09.354050 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 694/1362] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:09 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:10.368617 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-90c9d4aa-a942-479e-9d3c-bcdcdd72066c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:10.369230 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-90c9d4aa-a942-479e-9d3c-bcdcdd72066c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:10.375550 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-90c9d4aa-a942-479e-9d3c-bcdcdd72066c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:10.376110 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-90c9d4aa-a942-479e-9d3c-bcdcdd72066c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:10.376985 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-90c9d4aa-a942-479e-9d3c-bcdcdd72066c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:10.377427 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-90c9d4aa-a942-479e-9d3c-bcdcdd72066c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:10.519106 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-90c9d4aa-a942-479e-9d3c-bcdcdd72066c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:10.527072 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-90c9d4aa-a942-479e-9d3c-bcdcdd72066c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1264 microversion: 2.1 time: 0.162763 Jul 22 22:27:10.527633 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 669/1363] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:10 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:11.544137 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-6c9cbbe9-694f-4995-a0cb-02c99bbb119d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:11.544716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-6c9cbbe9-694f-4995-a0cb-02c99bbb119d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:11.550563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6c9cbbe9-694f-4995-a0cb-02c99bbb119d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:11.551002 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6c9cbbe9-694f-4995-a0cb-02c99bbb119d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:11.551760 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6c9cbbe9-694f-4995-a0cb-02c99bbb119d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:11.552191 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-6c9cbbe9-694f-4995-a0cb-02c99bbb119d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:11.690513 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-6c9cbbe9-694f-4995-a0cb-02c99bbb119d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:11.698602 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-6c9cbbe9-694f-4995-a0cb-02c99bbb119d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1264 microversion: 2.1 time: 0.158188 Jul 22 22:27:11.699173 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 695/1364] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:11 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:11.849742 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-aec0d810-f6d4-4d40-b1a4-e2355d11789d req-51fad0f9-d930-4206-9382-d1352d4905ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030bdb92-2107-4494-8e09-344eb31a0729", "name": "network-vif-plugged", "status": "completed", "tag": "a4921983-190d-442c-9183-00b08dbb9001"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:27:11.851616 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:27:11.851616 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:27:11.859341 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-aec0d810-f6d4-4d40-b1a4-e2355d11789d req-51fad0f9-d930-4206-9382-d1352d4905ab service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:11.859787 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-aec0d810-f6d4-4d40-b1a4-e2355d11789d req-51fad0f9-d930-4206-9382-d1352d4905ab service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:11.870868 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-aec0d810-f6d4-4d40-b1a4-e2355d11789d req-51fad0f9-d930-4206-9382-d1352d4905ab service nova] Creating event network-vif-plugged:a4921983-190d-442c-9183-00b08dbb9001 for instance 030bdb92-2107-4494-8e09-344eb31a0729 on hv-cinder-80186 Jul 22 22:27:11.876087 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-aec0d810-f6d4-4d40-b1a4-e2355d11789d req-51fad0f9-d930-4206-9382-d1352d4905ab service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087985 Jul 22 22:27:11.876766 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 670/1365] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:27:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:27:12.716247 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7e3b4e4e-618d-43c7-b8d0-bd450035794e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:12.716880 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7e3b4e4e-618d-43c7-b8d0-bd450035794e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:12.722800 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e3b4e4e-618d-43c7-b8d0-bd450035794e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:12.723244 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e3b4e4e-618d-43c7-b8d0-bd450035794e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:12.724007 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e3b4e4e-618d-43c7-b8d0-bd450035794e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:12.724481 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7e3b4e4e-618d-43c7-b8d0-bd450035794e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:12.864068 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7e3b4e4e-618d-43c7-b8d0-bd450035794e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:12.871760 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7e3b4e4e-618d-43c7-b8d0-bd450035794e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1264 microversion: 2.1 time: 0.159276 Jul 22 22:27:12.872348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 696/1366] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:12 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:13.890789 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-251092f5-1290-4579-8d25-c8ba904862af tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:13.891488 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-251092f5-1290-4579-8d25-c8ba904862af tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:13.897604 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-251092f5-1290-4579-8d25-c8ba904862af tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:13.898049 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-251092f5-1290-4579-8d25-c8ba904862af tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:13.899510 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-251092f5-1290-4579-8d25-c8ba904862af tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:13.900160 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-251092f5-1290-4579-8d25-c8ba904862af tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:14.074756 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-251092f5-1290-4579-8d25-c8ba904862af tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:14.088669 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-251092f5-1290-4579-8d25-c8ba904862af tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1447 microversion: 2.1 time: 0.201293 Jul 22 22:27:14.089621 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 671/1367] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:13 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1447 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:14.107984 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-64026307-a99e-43d9-a6c8-f49275c24083 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:27:14.110353 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-64026307-a99e-43d9-a6c8-f49275c24083 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:27:14.121903 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-64026307-a99e-43d9-a6c8-f49275c24083 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:14.122682 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-64026307-a99e-43d9-a6c8-f49275c24083 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:14.124990 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-64026307-a99e-43d9-a6c8-f49275c24083 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:14.124990 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-64026307-a99e-43d9-a6c8-f49275c24083 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:14.266218 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-64026307-a99e-43d9-a6c8-f49275c24083 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:27:14.274528 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-64026307-a99e-43d9-a6c8-f49275c24083 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1447 microversion: 2.1 time: 0.171283 Jul 22 22:27:14.275094 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 697/1368] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:27:14 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:27:16.291145 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-5c2200a9-f284-4118-8cc8-25183815677f req-e7bd7abf-e07e-4ef7-8d58-fe4087cc54db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030bdb92-2107-4494-8e09-344eb31a0729", "tag": "a4921983-190d-442c-9183-00b08dbb9001"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:27:16.293034 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:27:16.293034 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:27:16.300090 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-5c2200a9-f284-4118-8cc8-25183815677f req-e7bd7abf-e07e-4ef7-8d58-fe4087cc54db service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:27:16.300633 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-5c2200a9-f284-4118-8cc8-25183815677f req-e7bd7abf-e07e-4ef7-8d58-fe4087cc54db service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:27:16.314398 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-5c2200a9-f284-4118-8cc8-25183815677f req-e7bd7abf-e07e-4ef7-8d58-fe4087cc54db service nova] Creating event network-changed:a4921983-190d-442c-9183-00b08dbb9001 for instance 030bdb92-2107-4494-8e09-344eb31a0729 on hv-cinder-80186 Jul 22 22:27:16.319223 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-5c2200a9-f284-4118-8cc8-25183815677f req-e7bd7abf-e07e-4ef7-8d58-fe4087cc54db service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088240 Jul 22 22:27:16.319818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 672/1369] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:27:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:29:21.208394 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: ERROR oslo.messaging._drivers.impl_rabbit [-] [31c2f0c5-9786-4bfd-928f-a237671d36e1] AMQP server on 10.222.0.110:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 22 22:29:21.212685 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2a81e8e5-4b0c-42dd-8aff-76f47a65d99d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:29:21.213205 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2a81e8e5-4b0c-42dd-8aff-76f47a65d99d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:21.219277 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2a81e8e5-4b0c-42dd-8aff-76f47a65d99d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:21.219716 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2a81e8e5-4b0c-42dd-8aff-76f47a65d99d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:21.220518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2a81e8e5-4b0c-42dd-8aff-76f47a65d99d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:21.220944 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2a81e8e5-4b0c-42dd-8aff-76f47a65d99d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:21.243057 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-2a81e8e5-4b0c-42dd-8aff-76f47a65d99d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lazy-loading 'flavor' on Instance uuid 030bdb92-2107-4494-8e09-344eb31a0729 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:29:21.315872 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2a81e8e5-4b0c-42dd-8aff-76f47a65d99d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "POST /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729/action" status: 202 len: 0 microversion: 2.1 time: 0.109394 Jul 22 22:29:21.316485 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 698/1370] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:29:21 2021] POST /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:29:21.323427 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: ERROR oslo.messaging._drivers.impl_rabbit [-] [16b32c1b-22e6-46c2-9d54-d640c25a9a14] AMQP server on 10.222.0.110:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Jul 22 22:29:21.327264 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-05f5b4bb-bb97-446b-b465-5326b2a9954d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:21.327987 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-05f5b4bb-bb97-446b-b465-5326b2a9954d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:21.334135 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-05f5b4bb-bb97-446b-b465-5326b2a9954d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:21.334697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-05f5b4bb-bb97-446b-b465-5326b2a9954d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:21.335509 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-05f5b4bb-bb97-446b-b465-5326b2a9954d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:21.335911 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-05f5b4bb-bb97-446b-b465-5326b2a9954d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:21.529607 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-05f5b4bb-bb97-446b-b465-5326b2a9954d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:21.537107 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-05f5b4bb-bb97-446b-b465-5326b2a9954d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.215522 Jul 22 22:29:21.537812 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 673/1371] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:21 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:22.565721 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7f08e3ef-3b53-4d05-b4c4-6bc7fa77dc9d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:22.566444 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7f08e3ef-3b53-4d05-b4c4-6bc7fa77dc9d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:22.573749 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7f08e3ef-3b53-4d05-b4c4-6bc7fa77dc9d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:22.574189 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7f08e3ef-3b53-4d05-b4c4-6bc7fa77dc9d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:22.574950 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7f08e3ef-3b53-4d05-b4c4-6bc7fa77dc9d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:22.575402 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7f08e3ef-3b53-4d05-b4c4-6bc7fa77dc9d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:22.580509 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO oslo.messaging._drivers.impl_rabbit [-] [31c2f0c5-9786-4bfd-928f-a237671d36e1] Reconnected to AMQP server on 10.222.0.110:5672 via [amqp] client with port 38768. Jul 22 22:29:22.761357 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7f08e3ef-3b53-4d05-b4c4-6bc7fa77dc9d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:22.768758 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7f08e3ef-3b53-4d05-b4c4-6bc7fa77dc9d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.217963 Jul 22 22:29:22.769310 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 699/1372] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:22 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:23.785688 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1bd33b12-f2ec-4db3-8155-d1569b222780 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:23.786293 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1bd33b12-f2ec-4db3-8155-d1569b222780 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:23.803761 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1bd33b12-f2ec-4db3-8155-d1569b222780 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:23.804225 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1bd33b12-f2ec-4db3-8155-d1569b222780 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:23.805288 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1bd33b12-f2ec-4db3-8155-d1569b222780 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:23.805721 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1bd33b12-f2ec-4db3-8155-d1569b222780 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:23.810957 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] [16b32c1b-22e6-46c2-9d54-d640c25a9a14] Reconnected to AMQP server on 10.222.0.110:5672 via [amqp] client with port 38776. Jul 22 22:29:23.943547 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1bd33b12-f2ec-4db3-8155-d1569b222780 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:23.951454 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1bd33b12-f2ec-4db3-8155-d1569b222780 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.169447 Jul 22 22:29:23.952016 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 674/1373] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:23 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:24.968618 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-643f60dc-6a29-483d-a955-0450f9fbd1b2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:24.969233 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-643f60dc-6a29-483d-a955-0450f9fbd1b2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:24.975348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-643f60dc-6a29-483d-a955-0450f9fbd1b2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:24.976008 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-643f60dc-6a29-483d-a955-0450f9fbd1b2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:24.976822 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-643f60dc-6a29-483d-a955-0450f9fbd1b2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:24.977258 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-643f60dc-6a29-483d-a955-0450f9fbd1b2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:25.114277 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-643f60dc-6a29-483d-a955-0450f9fbd1b2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:25.122809 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-643f60dc-6a29-483d-a955-0450f9fbd1b2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.157977 Jul 22 22:29:25.123367 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 700/1374] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:24 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:26.141283 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-1309c5ff-1b27-4982-9d74-2677229fd47c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:26.141884 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-1309c5ff-1b27-4982-9d74-2677229fd47c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:26.148476 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1309c5ff-1b27-4982-9d74-2677229fd47c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:26.148932 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1309c5ff-1b27-4982-9d74-2677229fd47c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:26.149714 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1309c5ff-1b27-4982-9d74-2677229fd47c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:26.150148 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-1309c5ff-1b27-4982-9d74-2677229fd47c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:26.283774 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-1309c5ff-1b27-4982-9d74-2677229fd47c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:26.291260 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-1309c5ff-1b27-4982-9d74-2677229fd47c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.154167 Jul 22 22:29:26.291812 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 675/1375] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:26 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:27.308631 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-2beb6b79-d983-45a2-83d5-8f7bc675f2d9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:27.309225 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-2beb6b79-d983-45a2-83d5-8f7bc675f2d9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:27.315057 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2beb6b79-d983-45a2-83d5-8f7bc675f2d9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:27.315509 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2beb6b79-d983-45a2-83d5-8f7bc675f2d9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:27.316301 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2beb6b79-d983-45a2-83d5-8f7bc675f2d9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:27.316728 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-2beb6b79-d983-45a2-83d5-8f7bc675f2d9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:27.451465 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-2beb6b79-d983-45a2-83d5-8f7bc675f2d9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:27.458688 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-2beb6b79-d983-45a2-83d5-8f7bc675f2d9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.154209 Jul 22 22:29:27.459239 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 701/1376] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:27 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:28.474917 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-75303f76-4467-418b-babe-0a48e08646a7 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:28.475488 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-75303f76-4467-418b-babe-0a48e08646a7 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:28.481695 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-75303f76-4467-418b-babe-0a48e08646a7 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:28.482142 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-75303f76-4467-418b-babe-0a48e08646a7 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:28.482913 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-75303f76-4467-418b-babe-0a48e08646a7 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:28.483344 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-75303f76-4467-418b-babe-0a48e08646a7 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:28.628590 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-75303f76-4467-418b-babe-0a48e08646a7 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:28.636640 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-75303f76-4467-418b-babe-0a48e08646a7 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.165557 Jul 22 22:29:28.637202 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 676/1377] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:28 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:29.654566 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5be4bc52-f0cd-4ff4-ba7e-53585c0831bc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:29.655163 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5be4bc52-f0cd-4ff4-ba7e-53585c0831bc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:29.661280 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5be4bc52-f0cd-4ff4-ba7e-53585c0831bc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:29.661730 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5be4bc52-f0cd-4ff4-ba7e-53585c0831bc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:29.662507 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5be4bc52-f0cd-4ff4-ba7e-53585c0831bc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:29.663677 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5be4bc52-f0cd-4ff4-ba7e-53585c0831bc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:29.798620 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-5be4bc52-f0cd-4ff4-ba7e-53585c0831bc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:29.806898 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5be4bc52-f0cd-4ff4-ba7e-53585c0831bc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.155964 Jul 22 22:29:29.807471 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 702/1378] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:29 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:30.824156 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2243088f-c1b4-4afc-a97a-726a1d492c52 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:30.824892 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2243088f-c1b4-4afc-a97a-726a1d492c52 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:30.830829 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2243088f-c1b4-4afc-a97a-726a1d492c52 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:30.831280 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2243088f-c1b4-4afc-a97a-726a1d492c52 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:30.832050 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2243088f-c1b4-4afc-a97a-726a1d492c52 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:30.832515 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2243088f-c1b4-4afc-a97a-726a1d492c52 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:30.975243 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2243088f-c1b4-4afc-a97a-726a1d492c52 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:30.983188 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2243088f-c1b4-4afc-a97a-726a1d492c52 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.162804 Jul 22 22:29:30.983744 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 677/1379] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:30 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:32.000913 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-18ba29dd-2e12-4567-a756-60c662efc600 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:32.001531 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-18ba29dd-2e12-4567-a756-60c662efc600 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:32.008312 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-18ba29dd-2e12-4567-a756-60c662efc600 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:32.008782 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-18ba29dd-2e12-4567-a756-60c662efc600 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:32.009568 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-18ba29dd-2e12-4567-a756-60c662efc600 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:32.010004 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-18ba29dd-2e12-4567-a756-60c662efc600 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:32.153577 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-18ba29dd-2e12-4567-a756-60c662efc600 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:32.161103 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-18ba29dd-2e12-4567-a756-60c662efc600 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.163833 Jul 22 22:29:32.161672 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 703/1380] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:31 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:33.177922 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ef314ce5-713a-400f-8735-5e26aeb3d84c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:33.178562 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ef314ce5-713a-400f-8735-5e26aeb3d84c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:33.185044 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef314ce5-713a-400f-8735-5e26aeb3d84c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:33.185483 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef314ce5-713a-400f-8735-5e26aeb3d84c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:33.186240 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef314ce5-713a-400f-8735-5e26aeb3d84c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:33.186663 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ef314ce5-713a-400f-8735-5e26aeb3d84c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:33.333354 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ef314ce5-713a-400f-8735-5e26aeb3d84c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:33.341542 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ef314ce5-713a-400f-8735-5e26aeb3d84c tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.167393 Jul 22 22:29:33.342261 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 678/1381] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:33 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:34.360037 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-d96a81b2-7cdf-4b85-92a4-04f877951097 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:34.360781 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-d96a81b2-7cdf-4b85-92a4-04f877951097 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:34.368150 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d96a81b2-7cdf-4b85-92a4-04f877951097 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:34.368774 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d96a81b2-7cdf-4b85-92a4-04f877951097 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:34.369808 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d96a81b2-7cdf-4b85-92a4-04f877951097 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:34.370375 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-d96a81b2-7cdf-4b85-92a4-04f877951097 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:34.513197 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-d96a81b2-7cdf-4b85-92a4-04f877951097 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:34.520742 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-d96a81b2-7cdf-4b85-92a4-04f877951097 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.165458 Jul 22 22:29:34.521336 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 704/1382] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:34 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:35.539015 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-53eb75d8-5c75-453b-9ae8-8dca6494f8da tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:35.539803 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-53eb75d8-5c75-453b-9ae8-8dca6494f8da tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:35.546039 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53eb75d8-5c75-453b-9ae8-8dca6494f8da tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:35.546486 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53eb75d8-5c75-453b-9ae8-8dca6494f8da tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:35.547267 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53eb75d8-5c75-453b-9ae8-8dca6494f8da tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:35.547700 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-53eb75d8-5c75-453b-9ae8-8dca6494f8da tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:35.689581 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-53eb75d8-5c75-453b-9ae8-8dca6494f8da tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:35.698120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-53eb75d8-5c75-453b-9ae8-8dca6494f8da tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.162884 Jul 22 22:29:35.698691 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 679/1383] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:35 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:36.717384 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-4c7f33c7-e395-4038-a4c5-b96433752737 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:36.717994 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-4c7f33c7-e395-4038-a4c5-b96433752737 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:36.723865 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4c7f33c7-e395-4038-a4c5-b96433752737 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:36.724341 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4c7f33c7-e395-4038-a4c5-b96433752737 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:36.725112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4c7f33c7-e395-4038-a4c5-b96433752737 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:36.725564 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-4c7f33c7-e395-4038-a4c5-b96433752737 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:36.866470 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-4c7f33c7-e395-4038-a4c5-b96433752737 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:36.875064 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-4c7f33c7-e395-4038-a4c5-b96433752737 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.161467 Jul 22 22:29:36.875668 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 705/1384] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:36 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:37.892114 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d3170285-f1f5-46e7-ae0a-b63fedd11b7a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:37.892739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d3170285-f1f5-46e7-ae0a-b63fedd11b7a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:37.898665 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d3170285-f1f5-46e7-ae0a-b63fedd11b7a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:37.899635 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d3170285-f1f5-46e7-ae0a-b63fedd11b7a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:37.900430 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d3170285-f1f5-46e7-ae0a-b63fedd11b7a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:37.900867 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d3170285-f1f5-46e7-ae0a-b63fedd11b7a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:38.033149 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-d3170285-f1f5-46e7-ae0a-b63fedd11b7a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:38.041132 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d3170285-f1f5-46e7-ae0a-b63fedd11b7a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.152577 Jul 22 22:29:38.041688 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 680/1385] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:37 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:39.059586 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-de7bb7be-cdcb-4215-88cd-4e8c01c15cf4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:39.060354 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-de7bb7be-cdcb-4215-88cd-4e8c01c15cf4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:39.066270 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-de7bb7be-cdcb-4215-88cd-4e8c01c15cf4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:39.066709 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-de7bb7be-cdcb-4215-88cd-4e8c01c15cf4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:39.067463 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-de7bb7be-cdcb-4215-88cd-4e8c01c15cf4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:39.067890 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-de7bb7be-cdcb-4215-88cd-4e8c01c15cf4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:39.207226 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-de7bb7be-cdcb-4215-88cd-4e8c01c15cf4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:39.214530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-de7bb7be-cdcb-4215-88cd-4e8c01c15cf4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.160120 Jul 22 22:29:39.215080 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 706/1386] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:39 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:40.232007 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-a081c285-a1e0-43dc-bd0d-e330b45e6fc9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:40.232602 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-a081c285-a1e0-43dc-bd0d-e330b45e6fc9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:40.238338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a081c285-a1e0-43dc-bd0d-e330b45e6fc9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:40.238794 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a081c285-a1e0-43dc-bd0d-e330b45e6fc9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:40.239594 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a081c285-a1e0-43dc-bd0d-e330b45e6fc9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:40.240029 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-a081c285-a1e0-43dc-bd0d-e330b45e6fc9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:40.483019 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-a081c285-a1e0-43dc-bd0d-e330b45e6fc9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:40.490462 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-a081c285-a1e0-43dc-bd0d-e330b45e6fc9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1572 microversion: 2.1 time: 0.263367 Jul 22 22:29:40.491032 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 681/1387] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:40 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1572 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:40.506957 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-5b845faf-7e40-4c07-a77a-aa0caa8b047b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:29:40.507530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-5b845faf-7e40-4c07-a77a-aa0caa8b047b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:40.514348 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5b845faf-7e40-4c07-a77a-aa0caa8b047b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:40.514799 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5b845faf-7e40-4c07-a77a-aa0caa8b047b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:40.515563 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5b845faf-7e40-4c07-a77a-aa0caa8b047b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:40.515995 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-5b845faf-7e40-4c07-a77a-aa0caa8b047b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:40.591322 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5b845faf-7e40-4c07-a77a-aa0caa8b047b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [99d65c7c-8f86-48e8-b92f-939c0f3be9a3] AMQP server on 10.222.0.110:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 22 22:29:41.608587 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO oslo.messaging._drivers.impl_rabbit [None req-5b845faf-7e40-4c07-a77a-aa0caa8b047b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [99d65c7c-8f86-48e8-b92f-939c0f3be9a3] Reconnected to AMQP server on 10.222.0.110:5672 via [amqp] client with port 38822. Jul 22 22:29:41.611648 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-5b845faf-7e40-4c07-a77a-aa0caa8b047b tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "POST /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729/action" status: 202 len: 0 microversion: 2.1 time: 1.108457 Jul 22 22:29:41.612254 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 707/1388] 10.222.0.110 () {60 vars in 1283 bytes} [Thu Jul 22 22:29:40 2021] POST /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729/action => generated 0 bytes in 1110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 22 22:29:41.620255 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-4ab8e659-aca4-487a-a3df-34d66f306ac3 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:41.620892 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-4ab8e659-aca4-487a-a3df-34d66f306ac3 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:41.627219 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ab8e659-aca4-487a-a3df-34d66f306ac3 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:41.627666 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ab8e659-aca4-487a-a3df-34d66f306ac3 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:41.628486 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ab8e659-aca4-487a-a3df-34d66f306ac3 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:41.628925 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-4ab8e659-aca4-487a-a3df-34d66f306ac3 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:41.785748 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-4ab8e659-aca4-487a-a3df-34d66f306ac3 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:41.793914 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-4ab8e659-aca4-487a-a3df-34d66f306ac3 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1520 microversion: 2.1 time: 0.177472 Jul 22 22:29:41.794492 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 682/1389] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:41 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:29:42.811312 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3889c424-de71-4c16-8882-dff7b23328b4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:42.811928 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3889c424-de71-4c16-8882-dff7b23328b4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:42.817808 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3889c424-de71-4c16-8882-dff7b23328b4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:42.818252 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3889c424-de71-4c16-8882-dff7b23328b4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:42.819010 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3889c424-de71-4c16-8882-dff7b23328b4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:42.819446 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3889c424-de71-4c16-8882-dff7b23328b4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:42.962616 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3889c424-de71-4c16-8882-dff7b23328b4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:42.970373 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3889c424-de71-4c16-8882-dff7b23328b4 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1520 microversion: 2.1 time: 0.162962 Jul 22 22:29:42.970943 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 708/1390] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:42 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:43.988498 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-efb66684-c96b-4719-ab90-a905b8b9cf02 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:43.989117 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-efb66684-c96b-4719-ab90-a905b8b9cf02 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:43.995904 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-efb66684-c96b-4719-ab90-a905b8b9cf02 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:43.996472 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-efb66684-c96b-4719-ab90-a905b8b9cf02 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:43.997299 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-efb66684-c96b-4719-ab90-a905b8b9cf02 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:43.997894 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-efb66684-c96b-4719-ab90-a905b8b9cf02 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:44.138825 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-efb66684-c96b-4719-ab90-a905b8b9cf02 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:44.146412 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-efb66684-c96b-4719-ab90-a905b8b9cf02 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1520 microversion: 2.1 time: 0.161534 Jul 22 22:29:44.146976 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 683/1391] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:43 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:44.574207 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-43cac9a0-9167-47ee-8397-f589af3efa54 req-72bfd417-0f14-4bb8-977f-b6ef8bcb2157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030bdb92-2107-4494-8e09-344eb31a0729", "name": "network-vif-unplugged", "status": "completed", "tag": "a4921983-190d-442c-9183-00b08dbb9001"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:29:44.575786 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:29:44.575786 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:29:44.584888 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-43cac9a0-9167-47ee-8397-f589af3efa54 req-72bfd417-0f14-4bb8-977f-b6ef8bcb2157 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:44.585325 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-43cac9a0-9167-47ee-8397-f589af3efa54 req-72bfd417-0f14-4bb8-977f-b6ef8bcb2157 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:44.597238 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.compute.server_external_events [req-43cac9a0-9167-47ee-8397-f589af3efa54 req-72bfd417-0f14-4bb8-977f-b6ef8bcb2157 service nova] Unable to find a host for instance 030bdb92-2107-4494-8e09-344eb31a0729. Dropping event network-vif-unplugged {{(pid=107499) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jul 22 22:29:44.598112 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-43cac9a0-9167-47ee-8397-f589af3efa54 req-72bfd417-0f14-4bb8-977f-b6ef8bcb2157 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028312 Jul 22 22:29:44.598689 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 709/1392] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:29:44 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 22 22:29:45.163128 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2f1d5c69-a5d9-4d20-b168-129e5b59c049 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:45.163741 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2f1d5c69-a5d9-4d20-b168-129e5b59c049 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:45.170105 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2f1d5c69-a5d9-4d20-b168-129e5b59c049 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:45.170558 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2f1d5c69-a5d9-4d20-b168-129e5b59c049 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:45.171338 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2f1d5c69-a5d9-4d20-b168-129e5b59c049 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:45.171804 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2f1d5c69-a5d9-4d20-b168-129e5b59c049 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:45.311231 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2f1d5c69-a5d9-4d20-b168-129e5b59c049 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:45.318883 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2f1d5c69-a5d9-4d20-b168-129e5b59c049 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1520 microversion: 2.1 time: 0.159422 Jul 22 22:29:45.319443 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 684/1393] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:45 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:46.336672 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-22311d8d-478c-454e-afa6-f7140b9fe0dc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:46.337986 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-22311d8d-478c-454e-afa6-f7140b9fe0dc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:46.344376 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22311d8d-478c-454e-afa6-f7140b9fe0dc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:46.344823 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22311d8d-478c-454e-afa6-f7140b9fe0dc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:46.345734 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22311d8d-478c-454e-afa6-f7140b9fe0dc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:46.346243 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-22311d8d-478c-454e-afa6-f7140b9fe0dc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:46.484097 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-22311d8d-478c-454e-afa6-f7140b9fe0dc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:46.491769 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-22311d8d-478c-454e-afa6-f7140b9fe0dc tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1522 microversion: 2.1 time: 0.158894 Jul 22 22:29:46.492357 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 710/1394] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:46 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:47.509478 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-ede6bb23-4c4f-4e6d-9677-52caea85858e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:47.510093 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-ede6bb23-4c4f-4e6d-9677-52caea85858e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:47.516138 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ede6bb23-4c4f-4e6d-9677-52caea85858e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:47.516616 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ede6bb23-4c4f-4e6d-9677-52caea85858e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:47.517387 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ede6bb23-4c4f-4e6d-9677-52caea85858e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:47.517824 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-ede6bb23-4c4f-4e6d-9677-52caea85858e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:47.685518 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-ede6bb23-4c4f-4e6d-9677-52caea85858e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:47.692998 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-ede6bb23-4c4f-4e6d-9677-52caea85858e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1578 microversion: 2.1 time: 0.187265 Jul 22 22:29:47.693565 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 685/1395] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:47 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1578 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:48.709816 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-1c71e3db-b6b1-4439-8d2f-40f95c197c97 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:48.710378 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-1c71e3db-b6b1-4439-8d2f-40f95c197c97 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:48.717116 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1c71e3db-b6b1-4439-8d2f-40f95c197c97 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:48.717559 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1c71e3db-b6b1-4439-8d2f-40f95c197c97 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:48.718318 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1c71e3db-b6b1-4439-8d2f-40f95c197c97 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:48.718748 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-1c71e3db-b6b1-4439-8d2f-40f95c197c97 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:48.863859 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-1c71e3db-b6b1-4439-8d2f-40f95c197c97 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:48.871761 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-1c71e3db-b6b1-4439-8d2f-40f95c197c97 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1578 microversion: 2.1 time: 0.165678 Jul 22 22:29:48.872333 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 711/1396] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:48 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:49.888936 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-b3cb416a-505e-4721-acb9-eaed4ec4eec6 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:49.889627 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-b3cb416a-505e-4721-acb9-eaed4ec4eec6 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:49.895970 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3cb416a-505e-4721-acb9-eaed4ec4eec6 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:49.896458 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3cb416a-505e-4721-acb9-eaed4ec4eec6 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:49.897263 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3cb416a-505e-4721-acb9-eaed4ec4eec6 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:49.897702 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-b3cb416a-505e-4721-acb9-eaed4ec4eec6 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:50.053299 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-b3cb416a-505e-4721-acb9-eaed4ec4eec6 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:50.060989 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-b3cb416a-505e-4721-acb9-eaed4ec4eec6 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1578 microversion: 2.1 time: 0.175824 Jul 22 22:29:50.061558 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 686/1397] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:49 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 22 22:29:51.077901 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-495eebb0-4435-4467-a8a7-0f0251d923b9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:51.078522 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-495eebb0-4435-4467-a8a7-0f0251d923b9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:51.084288 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-495eebb0-4435-4467-a8a7-0f0251d923b9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:51.084738 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-495eebb0-4435-4467-a8a7-0f0251d923b9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:51.085500 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-495eebb0-4435-4467-a8a7-0f0251d923b9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:51.085925 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-495eebb0-4435-4467-a8a7-0f0251d923b9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:51.224359 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-495eebb0-4435-4467-a8a7-0f0251d923b9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:51.231917 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-495eebb0-4435-4467-a8a7-0f0251d923b9 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1578 microversion: 2.1 time: 0.157664 Jul 22 22:29:51.232518 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 712/1398] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:51 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:52.250322 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-58c5e085-7047-4762-beb0-70289679ae9a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:52.250948 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-58c5e085-7047-4762-beb0-70289679ae9a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:52.257813 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-58c5e085-7047-4762-beb0-70289679ae9a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:52.258284 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-58c5e085-7047-4762-beb0-70289679ae9a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:52.259047 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-58c5e085-7047-4762-beb0-70289679ae9a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:52.259605 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-58c5e085-7047-4762-beb0-70289679ae9a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:52.407681 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-58c5e085-7047-4762-beb0-70289679ae9a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:52.415136 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-58c5e085-7047-4762-beb0-70289679ae9a tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1578 microversion: 2.1 time: 0.169781 Jul 22 22:29:52.415697 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 687/1399] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:52 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:53.433658 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-9bb6769b-f25c-435a-9d8d-8e42db86bdd5 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:53.434248 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-9bb6769b-f25c-435a-9d8d-8e42db86bdd5 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:53.440391 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9bb6769b-f25c-435a-9d8d-8e42db86bdd5 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:53.440842 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9bb6769b-f25c-435a-9d8d-8e42db86bdd5 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:53.441617 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9bb6769b-f25c-435a-9d8d-8e42db86bdd5 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:53.442049 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-9bb6769b-f25c-435a-9d8d-8e42db86bdd5 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:53.578431 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-9bb6769b-f25c-435a-9d8d-8e42db86bdd5 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:53.585847 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-9bb6769b-f25c-435a-9d8d-8e42db86bdd5 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1578 microversion: 2.1 time: 0.156334 Jul 22 22:29:53.586406 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 713/1400] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:53 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:54.602833 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-55003eb1-ba5e-437e-9278-92cf446d35a0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:54.603527 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-55003eb1-ba5e-437e-9278-92cf446d35a0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:54.610519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-55003eb1-ba5e-437e-9278-92cf446d35a0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:54.610973 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-55003eb1-ba5e-437e-9278-92cf446d35a0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:54.611757 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-55003eb1-ba5e-437e-9278-92cf446d35a0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:54.612196 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-55003eb1-ba5e-437e-9278-92cf446d35a0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:54.754120 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-55003eb1-ba5e-437e-9278-92cf446d35a0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:54.762310 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-55003eb1-ba5e-437e-9278-92cf446d35a0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1578 microversion: 2.1 time: 0.163263 Jul 22 22:29:54.762798 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 688/1401] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:54 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:55.778884 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-976913f3-c39c-485c-a076-15e48eee039d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:55.779481 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-976913f3-c39c-485c-a076-15e48eee039d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:55.788133 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-976913f3-c39c-485c-a076-15e48eee039d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:55.788983 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-976913f3-c39c-485c-a076-15e48eee039d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:55.790361 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-976913f3-c39c-485c-a076-15e48eee039d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:55.791144 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-976913f3-c39c-485c-a076-15e48eee039d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:55.933096 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-976913f3-c39c-485c-a076-15e48eee039d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:55.940623 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-976913f3-c39c-485c-a076-15e48eee039d tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1578 microversion: 2.1 time: 0.165421 Jul 22 22:29:55.941195 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 714/1402] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:55 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:56.674593 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-54a6c498-5eaf-4565-9067-25d3032a0e96 req-6a863823-63d8-4459-8320-fe087f34977f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030bdb92-2107-4494-8e09-344eb31a0729", "name": "network-vif-plugged", "status": "completed", "tag": "a4921983-190d-442c-9183-00b08dbb9001"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:29:56.676762 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:29:56.676762 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:29:56.684693 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-54a6c498-5eaf-4565-9067-25d3032a0e96 req-6a863823-63d8-4459-8320-fe087f34977f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:56.685208 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-54a6c498-5eaf-4565-9067-25d3032a0e96 req-6a863823-63d8-4459-8320-fe087f34977f service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:56.696540 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-54a6c498-5eaf-4565-9067-25d3032a0e96 req-6a863823-63d8-4459-8320-fe087f34977f service nova] Creating event network-vif-plugged:a4921983-190d-442c-9183-00b08dbb9001 for instance 030bdb92-2107-4494-8e09-344eb31a0729 on hv-cinder-80186 Jul 22 22:29:56.702304 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-54a6c498-5eaf-4565-9067-25d3032a0e96 req-6a863823-63d8-4459-8320-fe087f34977f service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031337 Jul 22 22:29:56.702903 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 689/1403] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:29:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:29:56.957387 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-7eda9a63-75c0-4a4f-a96f-ad2f658f4f4e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:56.958024 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-7eda9a63-75c0-4a4f-a96f-ad2f658f4f4e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:56.964069 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7eda9a63-75c0-4a4f-a96f-ad2f658f4f4e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:56.964539 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7eda9a63-75c0-4a4f-a96f-ad2f658f4f4e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:56.965308 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7eda9a63-75c0-4a4f-a96f-ad2f658f4f4e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:56.965741 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-7eda9a63-75c0-4a4f-a96f-ad2f658f4f4e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:57.101702 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-7eda9a63-75c0-4a4f-a96f-ad2f658f4f4e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:57.110277 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-7eda9a63-75c0-4a4f-a96f-ad2f658f4f4e tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1578 microversion: 2.1 time: 0.156606 Jul 22 22:29:57.110848 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 715/1404] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:56 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:58.127599 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-7ccd80bf-be6a-416a-8fb3-b0e9f415fe08 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:58.128354 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-7ccd80bf-be6a-416a-8fb3-b0e9f415fe08 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:58.134487 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7ccd80bf-be6a-416a-8fb3-b0e9f415fe08 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:58.134938 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7ccd80bf-be6a-416a-8fb3-b0e9f415fe08 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:58.136764 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7ccd80bf-be6a-416a-8fb3-b0e9f415fe08 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:58.137236 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-7ccd80bf-be6a-416a-8fb3-b0e9f415fe08 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:58.274146 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-7ccd80bf-be6a-416a-8fb3-b0e9f415fe08 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:58.281469 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-7ccd80bf-be6a-416a-8fb3-b0e9f415fe08 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1578 microversion: 2.1 time: 0.158000 Jul 22 22:29:58.282036 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 690/1405] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:58 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:29:59.299327 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-e213089e-2571-47a6-b5b8-3369e04b37fa tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:29:59.299906 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-e213089e-2571-47a6-b5b8-3369e04b37fa tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:29:59.305753 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e213089e-2571-47a6-b5b8-3369e04b37fa tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:59.306192 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e213089e-2571-47a6-b5b8-3369e04b37fa tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:59.306941 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e213089e-2571-47a6-b5b8-3369e04b37fa tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:29:59.307992 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-e213089e-2571-47a6-b5b8-3369e04b37fa tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:29:59.452084 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-e213089e-2571-47a6-b5b8-3369e04b37fa tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:29:59.459585 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-e213089e-2571-47a6-b5b8-3369e04b37fa tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1565 microversion: 2.1 time: 0.164171 Jul 22 22:29:59.460146 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 716/1406] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:29:59 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:30:11.521063 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:30:11.521622 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: Thu Jul 22 22:30:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:31:06.598073 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:31:06.598810 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: Thu Jul 22 22:31:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:31:22.270083 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-07065de0-c857-4334-8814-f23883cf7368 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:31:22.270581 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-07065de0-c857-4334-8814-f23883cf7368 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:31:22.276788 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-07065de0-c857-4334-8814-f23883cf7368 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:22.277237 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-07065de0-c857-4334-8814-f23883cf7368 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:22.278035 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-07065de0-c857-4334-8814-f23883cf7368 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:22.278474 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-07065de0-c857-4334-8814-f23883cf7368 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:22.304519 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-07065de0-c857-4334-8814-f23883cf7368 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Going to try to terminate instance {{(pid=107498) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 22 22:31:22.320453 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [req-574085aa-08e8-46dc-b009-fc9cecb453b9 req-4b8fcd1b-f82b-4855-874c-0cad45ec598c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030bdb92-2107-4494-8e09-344eb31a0729", "tag": "a4921983-190d-442c-9183-00b08dbb9001"}]} {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:31:22.321840 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:31:22.321840 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: warnings.warn(msg) Jul 22 22:31:22.329035 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-574085aa-08e8-46dc-b009-fc9cecb453b9 req-4b8fcd1b-f82b-4855-874c-0cad45ec598c service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:22.330111 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [req-574085aa-08e8-46dc-b009-fc9cecb453b9 req-4b8fcd1b-f82b-4855-874c-0cad45ec598c service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:22.341435 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.compute.server_external_events [req-574085aa-08e8-46dc-b009-fc9cecb453b9 req-4b8fcd1b-f82b-4855-874c-0cad45ec598c service nova] Creating event network-changed:a4921983-190d-442c-9183-00b08dbb9001 for instance 030bdb92-2107-4494-8e09-344eb31a0729 on hv-cinder-80186 Jul 22 22:31:22.347287 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [req-574085aa-08e8-46dc-b009-fc9cecb453b9 req-4b8fcd1b-f82b-4855-874c-0cad45ec598c service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085740 Jul 22 22:31:22.348133 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 717/1407] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:31:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:31:22.385796 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-07065de0-c857-4334-8814-f23883cf7368 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "DELETE /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 204 len: 0 microversion: 2.1 time: 0.126964 Jul 22 22:31:22.386528 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 691/1408] 10.222.0.110 () {58 vars in 1244 bytes} [Thu Jul 22 22:31:22 2021] DELETE /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 22 22:31:22.395915 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-b2ae230d-3439-4af3-bb9a-4283485ce0e0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:31:22.396645 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-b2ae230d-3439-4af3-bb9a-4283485ce0e0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:31:22.402862 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2ae230d-3439-4af3-bb9a-4283485ce0e0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:22.403305 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2ae230d-3439-4af3-bb9a-4283485ce0e0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:22.404417 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2ae230d-3439-4af3-bb9a-4283485ce0e0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:22.404847 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-b2ae230d-3439-4af3-bb9a-4283485ce0e0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:22.549848 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-b2ae230d-3439-4af3-bb9a-4283485ce0e0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:31:22.557385 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-b2ae230d-3439-4af3-bb9a-4283485ce0e0 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1571 microversion: 2.1 time: 0.166367 Jul 22 22:31:22.567549 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 718/1409] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:31:22 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:31:23.575594 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-2c669688-c927-41fa-a622-123dc9457fb2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:31:23.576317 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-2c669688-c927-41fa-a622-123dc9457fb2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:31:23.582892 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c669688-c927-41fa-a622-123dc9457fb2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:23.583337 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c669688-c927-41fa-a622-123dc9457fb2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:23.584102 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c669688-c927-41fa-a622-123dc9457fb2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:23.584559 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-2c669688-c927-41fa-a622-123dc9457fb2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:23.721818 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.policy [None req-2c669688-c927-41fa-a622-123dc9457fb2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107498) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:31:23.729333 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-2c669688-c927-41fa-a622-123dc9457fb2 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1453 microversion: 2.1 time: 0.157787 Jul 22 22:31:23.729883 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 692/1410] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:31:23 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:31:24.746157 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-3e175813-65dc-4c31-8cc5-d7bfe846f779 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:31:24.746852 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-3e175813-65dc-4c31-8cc5-d7bfe846f779 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:31:24.752815 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3e175813-65dc-4c31-8cc5-d7bfe846f779 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:24.753331 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3e175813-65dc-4c31-8cc5-d7bfe846f779 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:24.754095 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3e175813-65dc-4c31-8cc5-d7bfe846f779 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:24.754558 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-3e175813-65dc-4c31-8cc5-d7bfe846f779 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:24.894530 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-3e175813-65dc-4c31-8cc5-d7bfe846f779 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:31:24.902512 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-3e175813-65dc-4c31-8cc5-d7bfe846f779 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1453 microversion: 2.1 time: 0.160003 Jul 22 22:31:24.903433 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 719/1411] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:31:24 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:31:25.053568 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [req-b32ae018-9a1a-43f7-85b6-5d78fb180552 req-85506c69-8c19-46fe-b004-6af9d27e0bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030bdb92-2107-4494-8e09-344eb31a0729", "name": "network-vif-deleted", "tag": "a4921983-190d-442c-9183-00b08dbb9001"}]} {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 22 22:31:25.055123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 22 22:31:25.055123 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: warnings.warn(msg) Jul 22 22:31:25.062566 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-b32ae018-9a1a-43f7-85b6-5d78fb180552 req-85506c69-8c19-46fe-b004-6af9d27e0bc6 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:25.063001 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [req-b32ae018-9a1a-43f7-85b6-5d78fb180552 req-85506c69-8c19-46fe-b004-6af9d27e0bc6 service nova] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:25.074555 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.compute.server_external_events [req-b32ae018-9a1a-43f7-85b6-5d78fb180552 req-85506c69-8c19-46fe-b004-6af9d27e0bc6 service nova] Creating event network-vif-deleted:a4921983-190d-442c-9183-00b08dbb9001 for instance 030bdb92-2107-4494-8e09-344eb31a0729 on hv-cinder-80186 Jul 22 22:31:25.079979 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [req-b32ae018-9a1a-43f7-85b6-5d78fb180552 req-85506c69-8c19-46fe-b004-6af9d27e0bc6 service nova] 10.222.0.110 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029481 Jul 22 22:31:25.080739 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 693/1412] 10.222.0.110 () {64 vars in 1323 bytes} [Thu Jul 22 22:31:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 22 22:31:25.919935 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-ff49ec37-e828-489e-a0c4-09d8ec0b4798 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:31:25.920590 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.compute.api [None req-ff49ec37-e828-489e-a0c4-09d8ec0b4798 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107499) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:31:25.926360 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff49ec37-e828-489e-a0c4-09d8ec0b4798 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:25.926796 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff49ec37-e828-489e-a0c4-09d8ec0b4798 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:25.927546 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff49ec37-e828-489e-a0c4-09d8ec0b4798 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:25.928136 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff49ec37-e828-489e-a0c4-09d8ec0b4798 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:25.959387 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff49ec37-e828-489e-a0c4-09d8ec0b4798 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:25.959831 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG oslo_concurrency.lockutils [None req-ff49ec37-e828-489e-a0c4-09d8ec0b4798 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107499) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:25.960266 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.objects.instance [None req-ff49ec37-e828-489e-a0c4-09d8ec0b4798 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lazy-loading 'fault' on Instance uuid 030bdb92-2107-4494-8e09-344eb31a0729 {{(pid=107499) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 22 22:31:26.008117 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.policy [None req-ff49ec37-e828-489e-a0c4-09d8ec0b4798 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92ddd9c32ba24fccbc7fc5f099be1f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '748160a4ef46401a8836e6b4346ee31c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107499) authorize /opt/stack/nova/nova/policy.py:199}} Jul 22 22:31:26.015354 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-ff49ec37-e828-489e-a0c4-09d8ec0b4798 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 200 len: 1228 microversion: 2.1 time: 0.099031 Jul 22 22:31:26.015906 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 720/1413] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:31:25 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 1228 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 22 22:31:27.035183 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d46afa7b-8efb-45da-81d1-8bfa32eedfea tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '>' {{(pid=107498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:31:27.035910 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.compute.api [None req-d46afa7b-8efb-45da-81d1-8bfa32eedfea tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [instance: 030bdb92-2107-4494-8e09-344eb31a0729] Fetching instance by UUID {{(pid=107498) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 22 22:31:27.041999 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d46afa7b-8efb-45da-81d1-8bfa32eedfea tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:27.042438 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d46afa7b-8efb-45da-81d1-8bfa32eedfea tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:27.043186 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d46afa7b-8efb-45da-81d1-8bfa32eedfea tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 22 22:31:27.043614 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG oslo_concurrency.lockutils [None req-d46afa7b-8efb-45da-81d1-8bfa32eedfea tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Lock "d5f4ff4e-504c-4af6-92c6-2f1d71fba296" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 22 22:31:27.056470 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.wsgi [None req-d46afa7b-8efb-45da-81d1-8bfa32eedfea tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] HTTP exception thrown: Instance 030bdb92-2107-4494-8e09-344eb31a0729 could not be found. Jul 22 22:31:27.057056 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: DEBUG nova.api.openstack.wsgi [None req-d46afa7b-8efb-45da-81d1-8bfa32eedfea tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Returning 404 to user: Instance 030bdb92-2107-4494-8e09-344eb31a0729 could not be found. {{(pid=107498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 22 22:31:27.057876 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO nova.api.openstack.requestlog [None req-d46afa7b-8efb-45da-81d1-8bfa32eedfea tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729" status: 404 len: 111 microversion: 2.1 time: 0.027576 Jul 22 22:31:27.058413 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: [pid: 107498|app: 0|req: 694/1414] 10.222.0.110 () {58 vars in 1241 bytes} [Thu Jul 22 22:31:27 2021] GET /compute/v2.1/servers/030bdb92-2107-4494-8e09-344eb31a0729 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 22 22:31:27.214980 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: DEBUG nova.api.openstack.wsgi [None req-19035f21-6acb-4393-93b8-f55644e59960 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] Calling method '.version_select at 0x7f7d1361ae50>' {{(pid=107499) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 22 22:31:27.218175 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: ERROR oslo.messaging._drivers.impl_rabbit [None req-19035f21-6acb-4393-93b8-f55644e59960 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [24421536-5cc3-4915-8e93-ebb1ae5528b5] AMQP server on 10.222.0.110:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 22 22:31:28.235343 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO oslo.messaging._drivers.impl_rabbit [None req-19035f21-6acb-4393-93b8-f55644e59960 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] [24421536-5cc3-4915-8e93-ebb1ae5528b5] Reconnected to AMQP server on 10.222.0.110:5672 via [amqp] client with port 38946. Jul 22 22:31:28.254542 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO nova.api.openstack.requestlog [None req-19035f21-6acb-4393-93b8-f55644e59960 tempest-TestShelveInstance-1907110613 tempest-TestShelveInstance-1907110613-project] 10.222.0.110 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1809215571" status: 202 len: 0 microversion: 2.1 time: 1.043407 Jul 22 22:31:28.255115 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: [pid: 107499|app: 0|req: 721/1415] 10.222.0.110 () {58 vars in 1259 bytes} [Thu Jul 22 22:31:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1809215571 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 22 22:33:31.540228 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:33:31.540876 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: Thu Jul 22 22:33:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:33:50.391411 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:33:50.391989 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: Thu Jul 22 22:33:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:34:01.253871 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:34:01.254410 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: Thu Jul 22 22:34:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:34:26.617126 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:34:26.617805 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: Thu Jul 22 22:34:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:35:11.246397 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:35:11.246978 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: Thu Jul 22 22:35:11 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:36:51.558037 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:36:51.558629 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: Thu Jul 22 22:36:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:36:54.967354 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:36:54.967908 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: Thu Jul 22 22:36:54 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:37:10.410100 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:37:10.410785 dv-cinder-801868-2-iscsi devstack@n-api.service[107499]: Thu Jul 22 22:37:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 22 22:37:21.271594 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 22 22:37:21.272113 dv-cinder-801868-2-iscsi devstack@n-api.service[107498]: Thu Jul 22 22:37:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!